Jul 03 04:15:09.460684 np0000004364 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jul 03 04:15:11.038040 np0000004364 nova-compute[98951]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98951) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jul 03 04:15:11.038952 np0000004364 nova-compute[98951]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98951) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jul 03 04:15:11.038952 np0000004364 nova-compute[98951]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jul 03 04:15:11.160132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:15:11.170302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:15:11.213654 np0000004364 nova-compute[98951]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jul 03 04:15:11.956113 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jul 03 04:15:11.956236 np0000004364 nova-compute[98951]: INFO nova.utils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] The long task thread pool MainProcess.long_task is initialized Jul 03 04:15:11.956577 np0000004364 nova-compute[98951]: INFO nova.virt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Loading compute driver 'libvirt.LibvirtDriver' Jul 03 04:15:12.151607 np0000004364 nova-compute[98951]: INFO nova.compute.provider_config [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jul 03 04:15:12.654616 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Acquiring lock "singleton_lock" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:15:12.654779 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Acquired lock "singleton_lock" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:15:12.654906 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Releasing lock "singleton_lock" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:15:12.655084 np0000004364 nova-compute[98951]: WARNING oslo_service.backend._threading.service [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] no_fork=True: running service in main process Jul 03 04:15:12.655380 np0000004364 nova-compute[98951]: INFO nova.service [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Starting compute node (version 33.1.0) Jul 03 04:15:13.159154 np0000004364 nova-compute[98951]: INFO nova.utils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] The default thread pool MainProcess.default is initialized Jul 03 04:15:13.159592 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:15:13.159757 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Starting event thread {{(pid=98951) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jul 03 04:15:13.160125 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Starting connection event dispatch thread {{(pid=98951) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jul 03 04:15:13.161268 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Connecting to libvirt: qemu:///system {{(pid=98951) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jul 03 04:15:14.269155 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Registering for lifecycle events {{(pid=98951) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jul 03 04:15:14.270269 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Registering for connection events: {{(pid=98951) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jul 03 04:15:14.271058 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Connection event '1' reason 'None' Jul 03 04:15:14.773676 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Cannot update service status on host "np0000004364" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000004364 could not be found. Jul 03 04:15:14.773827 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.mount [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Initialising _HostMountState generation 0 {{(pid=98951) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host capabilities Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: 190aeeb9-2544-4e04-93ad-068acb5ab197 Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: x86_64 Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: tcp Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: rdma Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.365311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: 65844272 Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: 16461068 Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: 0 Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: 0 Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.367435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: apparmor Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: 0 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: dac Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: 0 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: +64055:+993 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: +64055:+993 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-alpha Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: clipper Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-arm Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: qcom-dc-scm-v1-bmc Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: mori-bmc Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: ast2600-evb Jul 03 04:15:24.368475 np0000004364 nova-compute[98951]: borzoi Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: tiogapass-bmc Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: spitz Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-2.7 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: nuri Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: mcimx7d-sabre Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: romulus-bmc Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-3.0 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-5.0 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: npcm750-evb Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-2.10 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: rainier-bmc Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: mps3-an547 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: musca-b1 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: realview-pbx-a9 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: versatileab Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: kzm Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-2.8 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: fby35-bmc Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: musca-a Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-3.1 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: mcimx6ul-evk Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-5.1 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: smdkc210 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: sx1 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-2.11 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: imx25-pdk Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: stm32vldiscovery Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-2.9 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: orangepi-pc Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: quanta-q71l-bmc Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: z2 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-5.2 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: xilinx-zynq-a9 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: tosa Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: mps2-an500 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: virt-2.12 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: mps2-an521 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: sabrelite Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: mps2-an511 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: canon-a1100 Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: realview-eb Jul 03 04:15:24.369859 np0000004364 nova-compute[98951]: quanta-gbs-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: emcraft-sf2 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: realview-pb-a8 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: yosemitev2-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-7.0 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-4.0 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: raspi1ap Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: palmetto-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: sx1-v1 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: n810 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: g220a-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: n800 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: bletchley-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-7.1 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: tacoma-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-4.1 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: quanta-gsj Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: versatilepb Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: terrier Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: mainstone Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: realview-eb-mpcore Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: integratorcp Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-7.2 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: supermicrox11-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-4.2 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: witherspoon-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: qcom-firework-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: mps3-an524 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: kudo-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: vexpress-a9 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: midway Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: musicpal Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: lm3s811evb Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: lm3s6965evb Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: supermicro-x11spi-bmc Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: microbit Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: fby35 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: mps2-an505 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: mps2-an385 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-6.0 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: virt-8.0 Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: cubieboard Jul 03 04:15:24.371007 np0000004364 nova-compute[98951]: ast1030-evb Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: verdex Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: bpim2u Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: netduino2 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: mps2-an386 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: olimex-stm32-h405 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-6.1 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-8.1 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: raspi2b Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: vexpress-a15 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: fuji-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-6.2 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: sonorapass-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: cheetah Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-2.6 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: ast2500-evb Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: highbank Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: akita Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: connex Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: netduinoplus2 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: collie Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: raspi0 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: fp5280g2-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-arm Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: qcom-dc-scm-v1-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: mori-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: ast2600-evb Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: borzoi Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: tiogapass-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: spitz Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-2.7 Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: nuri Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: mcimx7d-sabre Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: romulus-bmc Jul 03 04:15:24.372160 np0000004364 nova-compute[98951]: virt-3.0 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-5.0 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: npcm750-evb Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-2.10 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: rainier-bmc Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: mps3-an547 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: musca-b1 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: realview-pbx-a9 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: versatileab Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: kzm Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-2.8 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: fby35-bmc Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: musca-a Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-3.1 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: mcimx6ul-evk Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-5.1 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: smdkc210 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: sx1 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-2.11 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: imx25-pdk Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: stm32vldiscovery Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-2.9 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: orangepi-pc Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: quanta-q71l-bmc Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: z2 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-5.2 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: xilinx-zynq-a9 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: tosa Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: mps2-an500 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-2.12 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: mps2-an521 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: sabrelite Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: mps2-an511 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: canon-a1100 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: realview-eb Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: quanta-gbs-bmc Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: emcraft-sf2 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: realview-pb-a8 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: yosemitev2-bmc Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-7.0 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: virt-4.0 Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: raspi1ap Jul 03 04:15:24.373412 np0000004364 nova-compute[98951]: palmetto-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: sx1-v1 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: n810 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: g220a-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: n800 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: bletchley-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-7.1 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: tacoma-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-4.1 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: quanta-gsj Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: versatilepb Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: terrier Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: mainstone Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: realview-eb-mpcore Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: integratorcp Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-7.2 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: supermicrox11-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-4.2 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: witherspoon-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: qcom-firework-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: mps3-an524 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: kudo-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: vexpress-a9 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: midway Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: musicpal Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: lm3s811evb Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: lm3s6965evb Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: supermicro-x11spi-bmc Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: microbit Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: fby35 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: mps2-an505 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: mps2-an385 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-6.0 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-8.0 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: cubieboard Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: ast1030-evb Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: verdex Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: bpim2u Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: netduino2 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: mps2-an386 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: olimex-stm32-h405 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-6.1 Jul 03 04:15:24.374428 np0000004364 nova-compute[98951]: virt-8.1 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: raspi2b Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: vexpress-a15 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: fuji-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-6.2 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: sonorapass-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: cheetah Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-2.6 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: ast2500-evb Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: highbank Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: akita Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: connex Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: netduinoplus2 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: collie Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: raspi0 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: fp5280g2-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-aarch64 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: qcom-dc-scm-v1-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: mori-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: ast2600-evb Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: borzoi Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: tiogapass-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: spitz Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-2.7 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: nuri Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: mcimx7d-sabre Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: romulus-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-3.0 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-5.0 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: npcm750-evb Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-2.10 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: rainier-bmc Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: mps3-an547 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: virt-2.8 Jul 03 04:15:24.375496 np0000004364 nova-compute[98951]: musca-b1 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: realview-pbx-a9 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: versatileab Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: kzm Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: fby35-bmc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: musca-a Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-3.1 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: mcimx6ul-evk Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-5.1 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: smdkc210 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: sx1 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-2.11 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: imx25-pdk Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: stm32vldiscovery Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-2.9 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: orangepi-pc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: quanta-q71l-bmc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: z2 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-5.2 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: xilinx-zynq-a9 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: xlnx-zcu102 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: tosa Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: mps2-an500 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-2.12 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: mps2-an521 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: sabrelite Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: mps2-an511 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: canon-a1100 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: realview-eb Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: quanta-gbs-bmc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: emcraft-sf2 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: realview-pb-a8 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: sbsa-ref Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: yosemitev2-bmc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-7.0 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: virt-4.0 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: raspi1ap Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: palmetto-bmc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: sx1-v1 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: n810 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: g220a-bmc Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: n800 Jul 03 04:15:24.376711 np0000004364 nova-compute[98951]: bletchley-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-7.1 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: tacoma-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-4.1 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: quanta-gsj Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: versatilepb Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: terrier Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: mainstone Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: realview-eb-mpcore Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: integratorcp Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-7.2 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: supermicrox11-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-4.2 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: witherspoon-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: qcom-firework-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: mps3-an524 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: kudo-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: vexpress-a9 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: midway Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: musicpal Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: lm3s811evb Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: lm3s6965evb Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: supermicro-x11spi-bmc Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: microbit Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: fby35 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: mps2-an505 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: mps2-an385 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-6.0 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-8.0 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: raspi3ap Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: cubieboard Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: ast1030-evb Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: verdex Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: bpim2u Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: netduino2 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: xlnx-versal-virt Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: mps2-an386 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: olimex-stm32-h405 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-6.1 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: virt-8.1 Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: raspi3b Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: raspi2b Jul 03 04:15:24.377648 np0000004364 nova-compute[98951]: vexpress-a15 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: fuji-bmc Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: virt-6.2 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: sonorapass-bmc Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: cheetah Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: virt-2.6 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: ast2500-evb Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: highbank Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: akita Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: connex Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: netduinoplus2 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: collie Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: raspi0 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: fp5280g2-bmc Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-cris Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: axis-dev88 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-i386 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-i440fx-noble-v2 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: ubuntu Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-q35-mantic Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-i440fx-impish-hpb Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-q35-5.2 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-q35-lunar-hpb Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-i440fx-mantic Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-i440fx-2.12 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-i440fx-2.0 Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-i440fx-xenial Jul 03 04:15:24.378615 np0000004364 nova-compute[98951]: pc-q35-kinetic Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-6.2 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-4.2 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-mantic-maxcpus Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-2.5 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-4.2 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-focal Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-hirsute Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-xenial Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-jammy-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-5.2 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-2.7 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-eoan-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-disco-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-groovy Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-zesty Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-lunar Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-mantic-hpb-maxcpus Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-groovy Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-7.1 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-artful Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-trusty Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-2.2 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-eoan-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-focal-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-8.1 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-jammy-maxcpus Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-bionic-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-mantic-hpb Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-artful Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-8.1 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-2.7 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-6.1 Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-kinetic Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-jammy-maxcpus Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-i440fx-yakkety Jul 03 04:15:24.379973 np0000004364 nova-compute[98951]: pc-q35-2.4 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-cosmic-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-7.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-2.10 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: x-remote Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-5.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-2.9 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-2.11 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-jammy-hpb-maxcpus Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-3.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-6.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-4.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-jammy Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-2.4 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-4.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-eoan Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-jammy-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-5.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-2.9 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-bionic-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-lunar Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: isapc Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-mantic-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-cosmic Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-2.6 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-mantic-maxcpus Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-3.1 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-bionic Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-disco-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-cosmic Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-2.12 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-bionic Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-kinetic-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-groovy-hpb Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-7.0 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-q35-noble-v2 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: ubuntu-q35 Jul 03 04:15:24.380900 np0000004364 nova-compute[98951]: pc-i440fx-lunar-hpb Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-disco Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-cosmic-hpb Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-noble Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: q35 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-2.1 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-8.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-impish Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-wily Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-8.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-2.6 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-6.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-impish Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-jammy Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-impish-hpb Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-hirsute Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-4.0.1 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-hirsute-hpb Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-7.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-5.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-2.8 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-2.10 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-3.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-6.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-zesty Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-7.2 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-4.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-focal Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: microvm Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-2.3 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-jammy-hpb-maxcpus Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-q35-8.2 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: q35 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-kinetic-hpb Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-focal-hpb Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-4.0 Jul 03 04:15:24.381908 np0000004364 nova-compute[98951]: pc-i440fx-noble Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-disco Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-groovy-hpb Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-8.2 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-hirsute-hpb Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-5.0 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-q35-6.2 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-2.8 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-eoan Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-q35-2.5 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-3.0 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-q35-yakkety Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-mantic-hpb-maxcpus Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-i440fx-7.2 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: pc-q35-2.11 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-m68k Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: mcf5208evb Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-7.0 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: an5206 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-6.0 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: q800 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-8.1 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-7.2 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-6.2 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-8.0 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: next-cube Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-7.1 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-6.1 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.382877 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-microblaze Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: petalogix-s3adsp1800 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: petalogix-ml605 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: xlnx-zynqmp-pmu Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-microblazeel Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: petalogix-s3adsp1800 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: petalogix-ml605 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: xlnx-zynqmp-pmu Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mips Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: mipssim Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mipsel Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: mipssim Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.384129 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mips64 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: mipssim Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: pica61 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: magnum Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mips64el Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: loongson3-virt Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: mipssim Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: pica61 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: magnum Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: boston Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: fuloong2e Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: g3beige Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: amigaone Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: virtex-ml507 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: mac99 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: ppce500 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: sam460ex Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: pegasos2 Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: bamboo Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: 40p Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: ref405ep Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: mpc8544ds Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.385855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-noble Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: amigaone Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: powernv9 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: powernv Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-4.1 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: mpc8544ds Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-6.1 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-2.5 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: powernv10 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-xenial Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-4.2 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-6.2 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-yakkety Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-2.6 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: ppce500 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-bionic-sxxm Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-2.7 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-3.0 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-8.0 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-5.0 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: 40p Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-lunar Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-2.8 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pegasos2 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-hirsute Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-3.1 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-8.1 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-5.1 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-eoan Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-2.9 Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-zesty Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: bamboo Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-groovy Jul 03 04:15:24.387591 np0000004364 nova-compute[98951]: pseries-focal Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: g3beige Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-8.2 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-5.2 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-disco Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.12-sxxm Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-mantic Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-kinetic Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.10 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-7.0 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: virtex-ml507 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.11 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.1 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-7.1 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-cosmic Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-bionic Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.12 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.2 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-7.2 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: mac99 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-impish Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-jammy Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-artful Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: sam460ex Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: ref405ep Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.3 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: powernv8 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-4.0 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-6.0 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-2.4 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64le Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries-noble Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: pseries Jul 03 04:15:24.388793 np0000004364 nova-compute[98951]: amigaone Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: powernv9 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: powernv Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-4.1 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: mpc8544ds Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-6.1 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-2.5 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: powernv10 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-xenial Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-4.2 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-6.2 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-yakkety Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-2.6 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: ppce500 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-bionic-sxxm Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-2.7 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-3.0 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-8.0 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-5.0 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: 40p Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-lunar Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-2.8 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pegasos2 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-hirsute Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-3.1 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-8.1 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-5.1 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-eoan Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-2.9 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-zesty Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: bamboo Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-groovy Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-focal Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: g3beige Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-8.2 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-5.2 Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-disco Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-2.12-sxxm Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-mantic Jul 03 04:15:24.390119 np0000004364 nova-compute[98951]: pseries-kinetic Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.10 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-7.0 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: virtex-ml507 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.11 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.1 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-7.1 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-cosmic Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-bionic Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.12 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.2 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-7.2 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: mac99 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-impish Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-jammy Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-artful Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: sam460ex Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: ref405ep Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.3 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: powernv8 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-4.0 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-6.0 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: pseries-2.4 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-riscv32 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: spike Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: opentitan Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: sifive_u Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: sifive_e Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.391128 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-riscv64 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: spike Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: microchip-icicle-kit Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: sifive_u Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: shakti_c Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: sifive_e Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-s390x Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-noble Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-8.0 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-disco Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-6.0 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.11 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-7.0 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-mantic Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-xenial Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-5.0 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-focal Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.8 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-4.0 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-zesty Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-8.2 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-6.2 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-3.0 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-groovy Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.5 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-7.2 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-5.2 Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-artful Jul 03 04:15:24.392554 np0000004364 nova-compute[98951]: s390-ccw-virtio-hirsute Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-4.2 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.10 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.7 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-lunar Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-eoan Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-kinetic Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-8.1 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-yakkety Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-6.1 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-cosmic Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-bionic Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.12 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-7.1 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.4 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-5.1 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.9 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-impish Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-4.1 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-jammy Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-3.1 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: s390-ccw-virtio-2.6 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sh4 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: shix Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: r2d Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.393378 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sh4eb Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: shix Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: r2d Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sparc Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SS-5 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SS-20 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: LX Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SPARCClassic Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: leon3_generic Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SPARCbook Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SS-4 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SS-600MP Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: SS-10 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Voyager Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sparc64 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: sun4u Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: niagara Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: sun4v Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: 64 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-x86_64 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: pc-i440fx-noble-v2 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: ubuntu Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: pc-q35-mantic Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: pc-i440fx-impish-hpb Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: pc-q35-5.2 Jul 03 04:15:24.394251 np0000004364 nova-compute[98951]: pc-q35-lunar-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-mantic Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-2.12 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-2.0 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-xenial Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-kinetic Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-6.2 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-4.2 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-mantic-maxcpus Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-2.5 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-4.2 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-focal Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-hirsute Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-xenial Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-jammy-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-5.2 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-2.7 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-eoan-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-zesty Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-groovy Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-disco-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-lunar Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-mantic-hpb-maxcpus Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-groovy Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-7.1 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-artful Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-trusty Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-2.2 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-focal-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-8.1 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-eoan-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-jammy-maxcpus Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-bionic-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-q35-mantic-hpb Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-artful Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-8.1 Jul 03 04:15:24.395397 np0000004364 nova-compute[98951]: pc-i440fx-2.7 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-6.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-kinetic Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-jammy-maxcpus Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-yakkety Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-2.4 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-cosmic-hpb Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-7.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-2.10 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: x-remote Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-5.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-2.9 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-2.11 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-jammy-hpb-maxcpus Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-3.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-6.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-4.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-jammy Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-2.4 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-4.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-eoan Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-jammy-hpb Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-5.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-2.9 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-bionic-hpb Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-lunar Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: isapc Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-mantic-hpb Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-cosmic Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-2.6 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-mantic-maxcpus Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-3.1 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-bionic Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-disco-hpb Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-cosmic Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-2.12 Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-i440fx-bionic Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-kinetic-hpb Jul 03 04:15:24.396092 np0000004364 nova-compute[98951]: pc-q35-groovy-hpb Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-7.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-noble-v2 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: ubuntu-q35 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-lunar-hpb Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-disco Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-cosmic-hpb Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-2.1 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-noble Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: q35 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-8.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-wily Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-impish Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-8.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-2.6 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-6.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-impish Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-jammy Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-impish-hpb Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-hirsute Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-4.0.1 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-hirsute-hpb Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-7.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-5.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-2.8 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-2.10 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-3.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-zesty Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-7.2 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-4.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-6.0 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-focal Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: microvm Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-2.3 Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-q35-jammy-hpb-maxcpus Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-disco Jul 03 04:15:24.396747 np0000004364 nova-compute[98951]: pc-i440fx-kinetic-hpb Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-4.0 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-focal-hpb Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-noble Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-q35-8.2 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: q35 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-groovy-hpb Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-hirsute-hpb Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-8.2 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-5.0 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-2.8 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-q35-6.2 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-eoan Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-q35-2.5 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-3.0 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-q35-yakkety Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-mantic-hpb-maxcpus Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-i440fx-7.2 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: pc-q35-2.11 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-xtensa Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: sim Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: kc705 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: ml605 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: ml605-nommu Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: lx60-nommu Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: lx200 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: lx200-nommu Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: lx60 Jul 03 04:15:24.397455 np0000004364 nova-compute[98951]: kc705-nommu Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: hvm Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: 32 Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-xtensaeb Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: sim Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: kc705 Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: ml605 Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: ml605-nommu Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: lx60-nommu Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: lx200 Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: lx200-nommu Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: lx60 Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: kc705-nommu Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-alpha Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: clipper Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: alpha Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.398170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: Jul 03 04:15:24.399137 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-arm Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: armv6l Jul 03 04:15:24.400385 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa270-c0 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-a15 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa270-b0 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-m4 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa270-a0 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: arm1176 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa270-b1 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-a7 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa270-a1 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-a8 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-r5 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: ti925t Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-r5f Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: arm1026 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-a9 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: cortex-m7 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa270 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa260 Jul 03 04:15:24.401366 np0000004364 nova-compute[98951]: pxa250 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: pxa270-c5 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: pxa261 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: pxa262 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: sa1110 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: cortex-r52 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: sa1100 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: max Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: cortex-m0 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: cortex-m33 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: arm946 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: pxa255 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: arm11mpcore Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: cortex-m55 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: arm926 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: arm1136 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: arm1136-r2 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: cortex-m3 Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.402104 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.402972 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: 2 Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: 3 Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-arm Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: armv6l Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: pxa270-c0 Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: cortex-a15 Jul 03 04:15:24.404299 np0000004364 nova-compute[98951]: pxa270-b0 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-m4 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa270-a0 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm1176 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa270-b1 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-a7 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa270-a1 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-a8 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-r5 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: ti925t Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-r5f Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm1026 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-a9 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-m7 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa270 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa260 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa250 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa270-c5 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa261 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa262 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: sa1110 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-r52 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: sa1100 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: max Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-m0 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-m33 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm946 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: pxa255 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm11mpcore Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: cortex-m55 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm926 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm1136 Jul 03 04:15:24.405302 np0000004364 nova-compute[98951]: arm1136-r2 Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: cortex-m3 Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: Jul 03 04:15:24.405859 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: 2 Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: 3 Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.407050 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-arm Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: armv7l Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: efi Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: pxa270-c0 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: cortex-a15 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: pxa270-b0 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: cortex-m4 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: pxa270-a0 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: arm1176 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: pxa270-b1 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: cortex-a7 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: pxa270-a1 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: cortex-a8 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: cortex-r5 Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: ti925t Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: cortex-r5f Jul 03 04:15:24.408148 np0000004364 nova-compute[98951]: arm1026 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-a9 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-m7 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa270 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa260 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa250 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa270-c5 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa261 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa262 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: sa1110 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-r52 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: sa1100 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: max Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-m0 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-m33 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: arm946 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: pxa255 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: arm11mpcore Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-m55 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: arm926 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: arm1136 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: arm1136-r2 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cortex-m3 Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: Jul 03 04:15:24.408999 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: Jul 03 04:15:24.409830 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: 2 Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: 3 Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-aarch64 Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: aarch64 Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: efi Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.411080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: neoverse-n2 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa270-c0 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-a15 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa270-b0 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-a57 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-m4 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa270-a0 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: arm1176 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa270-b1 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-a7 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa270-a1 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-a76 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: a64fx Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-a8 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: neoverse-v1 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-r5 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: ti925t Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-r5f Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: arm1026 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-a9 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: cortex-m7 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa270 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa260 Jul 03 04:15:24.412012 np0000004364 nova-compute[98951]: pxa250 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: pxa270-c5 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: pxa261 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: pxa262 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-a710 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: sa1110 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-r52 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: sa1100 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: max Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-a53 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-m0 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-m33 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-a72 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: arm946 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: pxa255 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-a55 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: arm11mpcore Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-m55 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: neoverse-n1 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: arm926 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: arm1136 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-a35 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: arm1136-r2 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cortex-m3 Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.412816 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.413577 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: 2 Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: 3 Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-cris Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: axis-dev88 Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: cris Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.414794 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.415780 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.417167 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-i386 Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: pc-i440fx-noble-v2 Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: i686 Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.613185 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.614213 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.615188 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: Jul 03 04:15:24.616171 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.617522 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-i386 Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: pc-q35-noble Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: i686 Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.618934 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.619893 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.620590 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: Jul 03 04:15:24.621159 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.622538 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-i386 Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: pc-q35-noble-v2 Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: i686 Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.624424 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.626146 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.627237 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.628144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.630055 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-i386 Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: pc-i440fx-noble Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: i686 Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.631475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.632597 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.633476 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.634475 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.636534 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-m68k Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: mcf5208evb Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: m68k Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.638836 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.640477 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-m68k Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: virt-8.2 Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: m68k Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.643278 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.645391 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-microblaze Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: petalogix-s3adsp1800 Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: microblaze Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.647664 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.649417 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-microblazeel Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: petalogix-s3adsp1800 Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: microblazeel Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.651745 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: Jul 03 04:15:24.653512 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mips Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: mips Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.655753 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: Jul 03 04:15:24.657584 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mipsel Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: mipsel Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: Jul 03 04:15:24.659824 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.661595 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mips64 Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: mips64 Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.663765 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.665636 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-mips64el Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: malta Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: mips64el Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.667784 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.669650 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: Jul 03 04:15:24.671895 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: g3beige Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: ppc Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.673978 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.675727 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64 Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: pseries-noble Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: ppc64 Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: POWER10 Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: POWER9 Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: POWER8 Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: POWER7 Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.678080 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.679716 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: tpm-spapr Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: spapr-tpm-proxy Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64 Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: powernv9 Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: ppc64 Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.682101 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: POWER10 Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: POWER9 Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: POWER8 Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: POWER7 Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.684112 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: tpm-spapr Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: spapr-tpm-proxy Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.686415 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64 Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: pseries-noble Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: ppc64 Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: POWER10 Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: POWER9 Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: POWER8 Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: POWER7 Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.688719 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: tpm-spapr Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: spapr-tpm-proxy Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.690470 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64le Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: pseries-noble Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: ppc64le Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.693055 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: POWER10 Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: POWER9 Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: POWER8 Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: POWER7 Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.694311 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: tpm-spapr Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: spapr-tpm-proxy Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: Jul 03 04:15:24.695592 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-ppc64le Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: powernv9 Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: ppc64le Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: POWER10 Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: POWER9 Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: POWER8 Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: POWER7 Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.696813 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: tpm-spapr Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: spapr-tpm-proxy Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.698311 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-riscv32 Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: riscv32 Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.699666 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.700855 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-riscv64 Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: virt Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: riscv64 Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.702163 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: rv64 Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: sifive-e51 Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: any Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: x-rv128 Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: shakti-c Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: max Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: thead-c906 Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: sifive-u54 Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: veyron-v1 Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.703162 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.704561 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-s390x Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: s390-ccw-virtio-noble Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: s390x Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.706144 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z13 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z990.3 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z13-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z990.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z196.2-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z14 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z14.2-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z990.4 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z196 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z10BC.2-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z114-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: gen16b Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z890.3-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: gen16a Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z990.5 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z196.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: zEC12 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: zEC12.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z9EC.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z9BC Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z9EC.3-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z800-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z14ZR1-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z890 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z990.4-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z9EC.3 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z13.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z10BC.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: gen15a-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: z14.2 Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: zBC12-base Jul 03 04:15:24.707153 np0000004364 nova-compute[98951]: gen16a-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z900.3 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z196-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z990 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z14-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z900.2 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z800 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10EC Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z14ZR1 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z900 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10EC.2 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10EC.2-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z900.2-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z900-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10EC.3 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z990.5-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: max Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: gen15b Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z9BC.2-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: gen15a Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z990.2-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10EC-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: gen16b-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z114 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z9EC-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z13s Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: gen15b-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: zEC12-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z890.3 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10EC.3-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z890.2-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z890.2 Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10BC-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: zEC12.2-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z890-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z9BC-base Jul 03 04:15:24.708069 np0000004364 nova-compute[98951]: z10BC Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z9EC Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z9EC.2-base Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z13.2-base Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z900.3-base Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z990.3-base Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z13s-base Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: zBC12 Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z990-base Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: z9BC.2 Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.708789 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.710254 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sh4 Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: shix Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: sh4 Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.711294 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: Jul 03 04:15:24.712621 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sh4eb Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: shix Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: sh4eb Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.714105 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.715103 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sparc Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: SS-5 Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: sparc Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.716400 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.717649 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-sparc64 Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: sun4u Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: sparc64 Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.718998 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.720014 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-x86_64 Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: pc-i440fx-noble-v2 Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: x86_64 Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: efi Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.721600 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.722614 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.723373 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.723932 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: Jul 03 04:15:24.725170 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-x86_64 Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: pc-q35-noble Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: x86_64 Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: efi Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: /usr/share/ovmf/OVMF.amdsev.fd Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.726547 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.727623 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.728481 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: Jul 03 04:15:24.729003 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: Jul 03 04:15:24.730208 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-x86_64 Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: pc-q35-noble-v2 Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: x86_64 Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: efi Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: /usr/share/ovmf/OVMF.amdsev.fd Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 03 04:15:24.731515 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.732568 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.733435 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.733969 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: Jul 03 04:15:24.734747 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-x86_64 Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: pc-i440fx-noble Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: x86_64 Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: efi Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.736016 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: /usr/share/OVMF/OVMF_CODE_4M.fd Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: on Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: off Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.737178 np0000004364 nova-compute[98951]: Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: qemu64 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: qemu32 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: phenom Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: pentium3 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: pentium2 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: pentium Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: n270 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: kvm64 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: kvm32 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: coreduo Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: core2duo Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: athlon Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Westmere-IBRS Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Westmere Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Snowridge Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Skylake-Server-noTSX-IBRS Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Skylake-Server-IBRS Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Skylake-Server Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Skylake-Client-noTSX-IBRS Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Skylake-Client-IBRS Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Skylake-Client Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: SapphireRapids Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: SandyBridge-IBRS Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: SandyBridge Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Penryn Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Opteron_G5 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Opteron_G4 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Opteron_G3 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Opteron_G2 Jul 03 04:15:24.738388 np0000004364 nova-compute[98951]: Opteron_G1 Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Nehalem-IBRS Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: IvyBridge-IBRS Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: IvyBridge Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Icelake-Server-noTSX Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Icelake-Server Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Haswell-noTSX-IBRS Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Haswell-noTSX Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Haswell-IBRS Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Haswell Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: EPYC-Rome Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: EPYC-Milan Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: EPYC-IBPB Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: EPYC-Genoa Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: EPYC Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Dhyana Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Cooperlake Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Conroe Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Cascadelake-Server-noTSX Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Cascadelake-Server Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Broadwell-noTSX-IBRS Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Broadwell-noTSX Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Broadwell-IBRS Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Broadwell Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: 486 Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: ide Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.739060 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: tpm-tis Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: tpm-crb Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: passthrough Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: emulator Jul 03 04:15:24.739909 np0000004364 nova-compute[98951]: external Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: 1.2 Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: 2.0 Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: relaxed Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: vapic Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: spinlocks Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: vpindex Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: runtime Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: synic Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: stimer Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: reset Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: vendor_id Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: frequencies Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: reenlightenment Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: tlbflush Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: ipi Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: avic Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.741197 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-xtensa Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: sim Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: xtensa Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.742217 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.743866 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98951) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-xtensaeb Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: sim Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: xtensaeb Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF_CODE.fd Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: /usr/share/AAVMF/AAVMF32_CODE.fd Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: rom Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: pflash Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: yes Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: no Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: file Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: anonymous Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: memfd Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: disk Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: cdrom Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: floppy Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: lun Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: fdc Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: sata Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: Jul 03 04:15:24.745803 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: sdl Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: vnc Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: spice Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: egl-headless Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: dbus Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: subsystem Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: default Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: mandatory Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: requisite Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: optional Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: pci Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: scsi Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtio-transitional Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtio-non-transitional Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: random Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: egd Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: path Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: handle Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtiofs Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: usb Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: pty Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: unix Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: spicevmc Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: virtio Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: qemu Jul 03 04:15:24.746948 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: builtin Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: {{(pid=98951) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Checking secure boot support for host arch (x86_64) {{(pid=98951) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Checking secure boot support for host arch (x86_64) {{(pid=98951) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Checking secure boot support for host arch (x86_64) {{(pid=98951) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jul 03 04:15:24.748642 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Secure Boot support detected Jul 03 04:15:25.189265 np0000004364 nova-compute[98951]: INFO nova.virt.node [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Generated node identity 1a5251c8-01ca-4243-8d62-6cfdc308a824 Jul 03 04:15:25.189586 np0000004364 nova-compute[98951]: INFO nova.virt.node [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Wrote node identity 1a5251c8-01ca-4243-8d62-6cfdc308a824 to /opt/stack/data/nova/compute_id Jul 03 04:15:25.692310 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Compute nodes ['1a5251c8-01ca-4243-8d62-6cfdc308a824'] for host np0000004364 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jul 03 04:15:25.692792 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Loading instances for host np0000004364 with expected_attrs: info_cache, metadata, system_metadata, numa_topology, flavor {{(pid=98951) init_host /opt/stack/nova/nova/compute/manager.py:1790}} Jul 03 04:15:26.194979 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Loaded 0 instances for host {{(pid=98951) init_host /opt/stack/nova/nova/compute/manager.py:1794}} Jul 03 04:15:26.697079 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jul 03 04:15:27.701554 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] No compute node record found for host np0000004364. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000004364 could not be found. Jul 03 04:15:27.702037 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:15:27.702037 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:15:27.702120 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:15:27.702246 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:15:27.760622 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:15:27.761399 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:15:27.774932 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:15:27.775262 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Hypervisor/Node resource view: name=np0000004364 free_ram=55566MB free_disk=75.19042587280273GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:15:27.775395 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:15:27.775628 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:15:28.278165 np0000004364 nova-compute[98951]: WARNING nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] No compute node record for np0000004364:1a5251c8-01ca-4243-8d62-6cfdc308a824: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 1a5251c8-01ca-4243-8d62-6cfdc308a824 could not be found. Jul 03 04:15:28.782372 np0000004364 nova-compute[98951]: INFO nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Compute node record created for np0000004364:np0000004364 with uuid: 1a5251c8-01ca-4243-8d62-6cfdc308a824 Jul 03 04:15:30.289191 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:15:30.289597 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:15:27 up 23 min, 2 users, load average: 2.64, 1.62, 0.83\n'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:15:30.737203 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] [req-c57e7cd0-8098-4140-8574-f2af2e2f347c] Created resource provider record via placement API for resource provider with UUID 1a5251c8-01ca-4243-8d62-6cfdc308a824 and name np0000004364. Jul 03 04:15:30.785773 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] /sys/module/kvm_amd/parameters/sev contains [N Jul 03 04:15:30.785773 np0000004364 nova-compute[98951]: ] {{(pid=98951) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jul 03 04:15:30.785952 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.host [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] kernel doesn't support AMD SEV Jul 03 04:15:30.786040 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:15:30.786250 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Updating inventory in ProviderTree for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jul 03 04:15:30.786518 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Libvirt baseline CPU Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: x86_64 Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: AMD Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: Jul 03 04:15:30.790251 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13812}} Jul 03 04:15:31.358795 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Updated inventory for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:974}} Jul 03 04:15:31.359103 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Updating resource provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 generation from 0 to 1 during operation: update_inventory {{(pid=98951) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jul 03 04:15:31.359103 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Updating inventory in ProviderTree for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jul 03 04:15:31.527657 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Updating resource provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 generation from 1 to 2 during operation: update_traits {{(pid=98951) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jul 03 04:15:32.034873 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:15:32.035025 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.259s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:15:32.035165 np0000004364 nova-compute[98951]: DEBUG nova.service [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98951) start /opt/stack/nova/nova/service.py:196}} Jul 03 04:15:32.049529 np0000004364 nova-compute[98951]: DEBUG nova.service [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98951) start /opt/stack/nova/nova/service.py:212}} Jul 03 04:15:32.061862 np0000004364 nova-compute[98951]: DEBUG nova.service [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] Join ServiceGroup membership for this service compute {{(pid=98951) start /opt/stack/nova/nova/service.py:222}} Jul 03 04:15:32.062078 np0000004364 nova-compute[98951]: DEBUG nova.servicegroup.drivers.db [None req-751846f7-e33a-4908-8c02-410e2d4afb7b None None] DB_Driver: join new ServiceGroup member np0000004364 to the compute group, service = {{(pid=98951) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 03 04:15:35.063573 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._sync_power_states {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:15:35.566245 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:15:35.567221 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 35.65 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:15:37.565015 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:16:11.214789 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.215292 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.215381 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.215588 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.215895 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.216079 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.216349 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.216547 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 03 04:16:11.216752 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager.update_available_resource {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:16:11.720100 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:16:11.720246 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:16:11.720289 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:16:11.720455 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:16:11.728185 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:16:11.728921 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:16:11.741150 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:16:11.741637 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Hypervisor/Node resource view: name=np0000004364 free_ram=55303MB free_disk=75.07707977294922GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:16:11.741783 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:16:11.742009 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:16:12.801192 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:16:12.801593 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:16:11 up 24 min, 2 users, load average: 1.84, 1.55, 0.85\n'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:16:12.844813 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:16:12.845054 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:16:13.347736 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:16:13.853466 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:16:13.854013 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.112s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:16:13.854013 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:17:13.849319 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.849965 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.850615 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.850615 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.851761 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.851761 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.851761 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.853620 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:13.853620 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 03 04:17:13.853620 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager.update_available_resource {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:17:14.361606 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:14.361606 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:14.361775 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:14.361891 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:17:14.372257 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:14.372857 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:14.390262 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:14.390955 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Hypervisor/Node resource view: name=np0000004364 free_ram=54880MB free_disk=75.03664016723633GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:17:14.390955 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:14.391651 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:15.451780 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:17:15.452279 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:17:14 up 25 min, 2 users, load average: 1.59, 1.50, 0.87\n'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:17:15.507231 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:15.507693 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:16.010822 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:16.516973 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:17:16.517506 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.126s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:16.517887 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:17:31.381160 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:31.381696 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:31.883954 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:32.463513 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:32.463911 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:32.466530 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:32.466715 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Claim successful on node np0000004364 Jul 03 04:17:33.621982 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:33.622481 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:34.125380 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:34.632488 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.169s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:34.633111 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:35.140539 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:35.140836 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:35.141881 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:35.143555 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:35.278488 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:35.278488 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:35.646085 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:17:35.780412 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:36.047561 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4937ea515754406fa0fc0d376433084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f331cd7f014a0eb91a6c479ad14d3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:36.149371 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:36.337419 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:36.338259 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:36.340597 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:36.341000 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Claim successful on node np0000004364 Jul 03 04:17:37.158857 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:37.160108 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:37.160360 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Creating image(s) Jul 03 04:17:37.161015 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:37.161113 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:37.161722 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:37.161923 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:37.162542 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:37.192841 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Successfully created port: aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:37.552421 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:37.553272 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:37.561906 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:37.565610 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:37.566601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.part --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:37.574824 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:17:37.637237 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.part --force-share --output=json" returned: 0 in 0.070s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:37.637845 np0000004364 nova-compute[98951]: DEBUG nova.virt.images [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] 60fe5a74-ce6e-4c15-8d86-83089993b0d3 was qcow2, converting to raw {{(pid=98951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 03 04:17:37.640486 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:17:37.640486 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.part /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.converted {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:37.839025 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.part /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.converted" returned: 0 in 0.197s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:37.846492 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.converted --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:37.926872 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97.converted --force-share --output=json" returned: 0 in 0.081s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:37.927751 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.765s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:37.928477 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:37.933182 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:37.934982 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppyxlkl_f/privsep.sock'] Jul 03 04:17:37.945585 np0000004364 sudo[110316]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppyxlkl_f/privsep.sock Jul 03 04:17:37.946255 np0000004364 sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 04:17:38.059979 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:38.245890 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:38.247164 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 04:17:38.353156 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Successfully updated port: aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:38.571350 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.234s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:38.571935 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:38.574216 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 04:17:38.574942 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 04:17:38.575025 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 04:17:38.575133 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:38.575505 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 04:17:38.575571 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 04:17:38.575616 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 04:17:38.575681 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:38.575741 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 04:17:38.785020 np0000004364 sudo[110316]: pam_unix(sudo:session): session closed for user root Jul 03 04:17:38.786698 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Spawned new privsep daemon via rootwrap Jul 03 04:17:38.787724 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 04:17:38.787857 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 04:17:38.787975 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 04:17:38.788065 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110393 Jul 03 04:17:38.855804 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-b5ee81e7-eef9-4b72-a375-30801621eafc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:38.856487 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-b5ee81e7-eef9-4b72-a375-30801621eafc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:38.856487 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:38.871948 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:38.888426 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-changed-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:38.888787 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Refreshing instance network info cache due to event network-changed-aff4956b-4a68-43c4-a12b-82169530ade7. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:38.888983 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] Acquiring lock "refresh_cache-b5ee81e7-eef9-4b72-a375-30801621eafc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:38.930658 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.059s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:38.931759 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:38.932255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:38.932740 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:38.935432 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:38.936101 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:39.001112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.064s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:39.002022 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:39.043976 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk 1073741824" returned: 0 in 0.042s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:39.045059 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.113s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:39.045501 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:39.083520 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:39.084081 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:39.085253 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:39.085808 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:39.116902 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.071s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:39.117336 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:39.117588 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:39.176450 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.058s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:39.177481 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Cannot resize image /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:39.178160 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:39.178580 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Ensure instance console log exists: /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:39.178827 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:39.178996 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:39.179131 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:39.224903 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '910e8830eace40529a20e5efded682cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71449bab216465bb9a55183718ff364', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:39.461216 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:39.586345 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:17:39.936071 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:39.994555 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Successfully created port: 48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:40.067864 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:40.067864 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:40.090952 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:40.107085 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Updating instance_info_cache with network_info: [{"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:40.569456 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:40.612553 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-b5ee81e7-eef9-4b72-a375-30801621eafc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:40.612943 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Instance network_info: |[{"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:40.613311 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] Acquired lock "refresh_cache-b5ee81e7-eef9-4b72-a375-30801621eafc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:40.613536 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Refreshing network info cache for port aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:40.618525 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Start _get_guest_xml network_info=[{"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:40.627433 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:40.630999 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1299959151', uuid='b5ee81e7-eef9-4b72-a375-30801621eafc'), owner=OwnerMeta(userid='4937ea515754406fa0fc0d376433084d', username='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member', projectid='80f331cd7f014a0eb91a6c479ad14d3f', projectname='tempest-ServerBootFromVolumeStableRescueTest-1451627323'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052260.6289792) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:40.632006 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:40.632433 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:40.634049 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:40.634257 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:40.635453 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:40.635764 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:40.635906 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:40.635998 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:40.636146 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:40.636241 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:40.636343 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:40.636520 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:40.636631 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:40.636723 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:40.636844 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:40.637046 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:40.652266 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:17:40.653195 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1299959151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1299959151',id=1,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-e90ft49j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:36Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=b5ee81e7-eef9-4b72-a375-30801621eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:40.653399 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:40.654258 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:40.655207 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'pci_devices' on Instance uuid b5ee81e7-eef9-4b72-a375-30801621eafc {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:40.923113 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Successfully updated port: 48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:41.090636 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.091254 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.101203 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:41.102221 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:41.102548 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Creating image(s) Jul 03 04:17:41.104013 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.104013 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.104013 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:41.104821 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:41.109120 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:41.111208 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:41.124132 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:41.144545 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.144545 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.147999 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:41.148199 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Claim successful on node np0000004364 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] End _get_guest_xml xml= Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: b5ee81e7-eef9-4b72-a375-30801621eafc Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: instance-00000001 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-server-1299959151 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 2026-07-03 04:17:40 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: True Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: bare Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: virtio Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: b5ee81e7-eef9-4b72-a375-30801621eafc Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: b5ee81e7-eef9-4b72-a375-30801621eafc Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: Jul 03 04:17:41.158602 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:41.160317 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Preparing to wait for external event network-vif-plugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:41.160317 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.160710 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.160803 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:41.161860 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1299959151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1299959151',id=1,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-e90ft49j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:36Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=b5ee81e7-eef9-4b72-a375-30801621eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:41.162480 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:41.163632 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:41.163996 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:41.181807 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.070s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:41.183574 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.186862 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.188006 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:41.196513 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:41.196513 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:41.238908 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Created schema index Interface.name {{(pid=98951) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jul 03 04:17:41.239008 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Created schema index Port.name {{(pid=98951) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jul 03 04:17:41.239178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Created schema index Bridge.name {{(pid=98951) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jul 03 04:17:41.239622 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jul 03 04:17:41.239756 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [POLLOUT] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.239853 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98951) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jul 03 04:17:41.242183 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.244822 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.268229 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.290839 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.093s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:41.300516 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:41.311490 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.317601 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:41.318021 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:41.319887 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.320187 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95fa5860-576a-56a6-b345-581107e6fabe', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:41.321288 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:41.322295 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:41.323726 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpuu7y2d8k/privsep.sock'] Jul 03 04:17:41.333314 np0000004364 sudo[110576]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpuu7y2d8k/privsep.sock Jul 03 04:17:41.335772 np0000004364 sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 04:17:41.347673 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk 1073741824" returned: 0 in 0.047s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:41.347935 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.161s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:41.348384 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:41.416269 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:41.416740 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:41.417087 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:41.430193 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:41.430556 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:41.432128 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:41.502014 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:41.502765 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Cannot resize image /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:41.502917 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:41.503138 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Ensure instance console log exists: /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:41.503482 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.503676 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.503852 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:41.525179 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-changed-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:41.525179 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Refreshing instance network info cache due to event network-changed-48061ba0-95c3-4156-9d02-bbcee76a06e5. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:41.525179 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:41.593252 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:41.626853 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 04:17:41.626961 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 04:17:41.627011 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 04:17:41.627036 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:41.627150 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 04:17:41.627195 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 04:17:41.627231 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 04:17:41.627280 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:41.627345 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 04:17:41.747618 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:41.758112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:41.758262 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:17:41.977683 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 04:17:42.009362 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:42.045242 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:42.091925 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Updated VIF entry in instance network info cache for port aff4956b-4a68-43c4-a12b-82169530ade7. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:17:42.092298 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Updating instance_info_cache with network_info: [{"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:42.169360 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:42.214596 np0000004364 sudo[110576]: pam_unix(sudo:session): session closed for user root Jul 03 04:17:42.216194 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Spawned new privsep daemon via rootwrap Jul 03 04:17:42.217345 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 04:17:42.217468 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 04:17:42.217604 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jul 03 04:17:42.217670 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110655 Jul 03 04:17:42.261739 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:42.319710 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:42.477075 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:42.477349 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:42.494141 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:42.508458 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:42.508755 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaff4956b-4a, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:42.509164 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaff4956b-4a, col_values=(('qos', UUID('09e4aa52-fd09-4518-8f4e-55a60fb425d6')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:42.510455 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaff4956b-4a, col_values=(('external_ids', {'iface-id': 'aff4956b-4a68-43c4-a12b-82169530ade7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:83:c8', 'vm-uuid': 'b5ee81e7-eef9-4b72-a375-30801621eafc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:42.519731 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:42.521065 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:42.526117 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:42.527818 np0000004364 nova-compute[98951]: INFO os_vif [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') Jul 03 04:17:42.594440 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bc9efb22-bc01-437f-865b-bf3ea2909ca7 req-7ed5ad18-90c3-46cd-a46e-4e9ef8e490e7 service nova] Releasing lock "refresh_cache-b5ee81e7-eef9-4b72-a375-30801621eafc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:42.822537 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:42.981599 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:42.998153 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:42.998153 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance network_info: |[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:42.998153 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:42.998153 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Refreshing network info cache for port 48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:42.999392 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start _get_guest_xml network_info=[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:43.003530 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:43.003530 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-722411084', uuid='985dc90b-e484-4add-b0d7-c37a5f952ce6'), owner=OwnerMeta(userid='910e8830eace40529a20e5efded682cf', username='tempest-ServerActionsTestOtherB-1313095942-project-member', projectid='a71449bab216465bb9a55183718ff364', projectname='tempest-ServerActionsTestOtherB-1313095942'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052263.0020185) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:43.003957 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:43.004285 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:43.006552 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:43.006552 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:43.007202 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:43.007536 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:43.007683 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:43.007774 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:43.007907 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:43.008004 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:43.008094 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:43.008237 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:43.008340 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:43.008462 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:43.008572 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:43.008683 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:43.018879 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:43.019414 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:43.019947 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:43.020643 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'pci_devices' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:43.488996 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.345s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:43.489436 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:43.491457 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.325s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:43.494244 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:43.494434 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Claim successful on node np0000004364 Jul 03 04:17:43.500175 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] End _get_guest_xml xml= Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: instance-00000002 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-server-722411084 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 2026-07-03 04:17:43 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: True Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: bare Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: virtio Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-1313095942-project-member Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-1313095942 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: Jul 03 04:17:43.523772 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:43.526988 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Preparing to wait for external event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:43.526988 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:43.526988 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:43.526988 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:43.526988 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:43.527295 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:43.527295 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:43.527295 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:43.527295 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.527295 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:43.527616 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:43.528895 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.529064 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc1a688e-06fd-5b6f-bede-3ec958e4e0bf', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:43.529756 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.530863 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:43.535307 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.537505 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.537613 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48061ba0-95, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:43.538030 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48061ba0-95, col_values=(('qos', UUID('1428540c-dcb5-42b4-a7a4-4418fb0984dd')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:43.538168 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48061ba0-95, col_values=(('external_ids', {'iface-id': '48061ba0-95c3-4156-9d02-bbcee76a06e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:5c:89', 'vm-uuid': '985dc90b-e484-4add-b0d7-c37a5f952ce6'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:43.539034 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.540054 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:43.549676 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:43.551599 np0000004364 nova-compute[98951]: INFO os_vif [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') Jul 03 04:17:43.684616 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:43.687978 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:43.721158 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:43.721305 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:43.824161 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:43.961388 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updated VIF entry in instance network info cache for port 48061ba0-95c3-4156-9d02-bbcee76a06e5. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:17:43.961677 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:43.995460 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:43.995460 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:43.996308 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:43.996308 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:44.044216 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:44.044351 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:44.044413 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No VIF found with MAC fa:16:3e:63:83:c8, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:17:44.044876 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Using config drive Jul 03 04:17:44.067807 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22f2a7dcc54e4df9bd2ae118f6c0943a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a85d5cd69b482e8742dec3d62015ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:44.111592 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:44.190066 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:44.223820 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:44.464500 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d5eaa8bf-ee0e-418d-bf50-a93c460f059d req-0826bb6b-7c23-4503-9eac-9263cc193eea service nova] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:44.497847 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:17:44.550872 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:44.584891 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Successfully created port: d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:44.772696 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:44.799770 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:44.855296 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:44.941113 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:44.941402 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:44.981415 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Creating config drive at /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk.config Jul 03 04:17:44.985435 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxtx9anp0 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:45.004514 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:45.010395 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxtx9anp0" returned: 0 in 0.025s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:45.073268 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:45.073268 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:45.073268 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No VIF found with MAC fa:16:3e:5e:5c:89, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:17:45.073268 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Using config drive Jul 03 04:17:45.162159 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Successfully updated port: d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:45.444173 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:45.452688 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:45.471548 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:45.474513 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:45.574534 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:45.584537 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:45.595401 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:45.665546 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "refresh_cache-bec76c6e-db77-4b75-9c7c-31b738b93874" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:45.665546 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquired lock "refresh_cache-bec76c6e-db77-4b75-9c7c-31b738b93874" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:45.665546 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:45.727918 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-changed-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:45.731224 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Refreshing instance network info cache due to event network-changed-d27aa4e3-2f20-4457-97ec-31ed5e43738f. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:45.731224 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] Acquiring lock "refresh_cache-bec76c6e-db77-4b75-9c7c-31b738b93874" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:45.738832 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Creating config drive at /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config Jul 03 04:17:45.743065 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgg5i1ly2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:45.769638 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgg5i1ly2" returned: 0 in 0.026s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:45.956826 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.465s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:45.958171 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.135s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:45.958485 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:45.964264 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:45.964818 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Claim successful on node np0000004364 Jul 03 04:17:46.014038 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:46.015240 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:46.015540 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Creating image(s) Jul 03 04:17:46.016079 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "/opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:46.016535 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "/opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:46.017075 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "/opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:46.017822 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:46.024127 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:46.029263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:46.097272 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.069s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:46.097866 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:46.098533 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:46.099127 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:46.103682 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:46.103820 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:46.162240 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:46.165764 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:46.166159 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:46.183509 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:46.201017 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk 1073741824" returned: 0 in 0.034s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:46.201017 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.102s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:46.201017 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:46.262741 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:46.263168 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] VM Started (Lifecycle Event) Jul 03 04:17:46.267771 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:46.268253 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:46.268546 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:46.301165 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:46.321462 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:46.335840 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:46.336370 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Cannot resize image /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:46.337141 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:46.337141 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Ensure instance console log exists: /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:46.337141 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:46.340557 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:46.340683 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:46.469023 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:46.469785 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:46.469785 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:46.470038 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:46.504158 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:46.592186 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7587acb8e89c425d807e8875a9c8cc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879afb1507f042ebbf29d91b8c5289c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:46.653352 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Updating instance_info_cache with network_info: [{"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:46.767871 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:46.780700 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:46.780700 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] VM Paused (Lifecycle Event) Jul 03 04:17:46.905738 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:46.981250 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jul 03 04:17:47.153586 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Releasing lock "refresh_cache-bec76c6e-db77-4b75-9c7c-31b738b93874" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:47.153586 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Instance network_info: |[{"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:47.154196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] Acquired lock "refresh_cache-bec76c6e-db77-4b75-9c7c-31b738b93874" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:47.154196 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Refreshing network info cache for port d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:47.158257 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Start _get_guest_xml network_info=[{"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:47.164973 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:47.167352 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1228910078', uuid='bec76c6e-db77-4b75-9c7c-31b738b93874'), owner=OwnerMeta(userid='22f2a7dcc54e4df9bd2ae118f6c0943a', username='tempest-VolumesAdminNegativeTest-263954481-project-member', projectid='f4a85d5cd69b482e8742dec3d62015ff', projectname='tempest-VolumesAdminNegativeTest-263954481'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052267.1657975) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:47.169154 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:47.169154 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:47.169775 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:47.170139 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:47.170968 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:47.171391 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:47.171525 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:47.171625 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:47.171757 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:47.171886 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:47.172048 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:47.172578 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:47.172578 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:47.172578 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:47.172578 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:47.172794 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:47.187901 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1228910078',display_name='tempest-VolumesAdminNegativeTest-server-1228910078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-volumesadminnegativetest-server-1228910078',id=3,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a85d5cd69b482e8742dec3d62015ff',ramdisk_id='',reservation_id='r-oezgzkge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-263954481',owner_user_name='tempest-VolumesAdminNegativeTest-263954481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:45Z,user_data=None,user_id='22f2a7dcc54e4df9bd2ae118f6c0943a',uuid=bec76c6e-db77-4b75-9c7c-31b738b93874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:47.188177 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Converting VIF {"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:47.189096 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:47.189794 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lazy-loading 'pci_devices' on Instance uuid bec76c6e-db77-4b75-9c7c-31b738b93874 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:47.264110 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Successfully created port: a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:47.283929 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:47.285367 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:47.399314 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:47.399559 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:47.486206 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:47.658078 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] End _get_guest_xml xml= Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: bec76c6e-db77-4b75-9c7c-31b738b93874 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: instance-00000003 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: tempest-VolumesAdminNegativeTest-server-1228910078 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 2026-07-03 04:17:47 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: True Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: bare Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: virtio Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: tempest-VolumesAdminNegativeTest-263954481-project-member Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: tempest-VolumesAdminNegativeTest-263954481 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: bec76c6e-db77-4b75-9c7c-31b738b93874 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: bec76c6e-db77-4b75-9c7c-31b738b93874 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: Jul 03 04:17:47.692822 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:47.695721 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Preparing to wait for external event network-vif-plugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:47.695721 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:47.695721 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:47.695721 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:47.695721 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1228910078',display_name='tempest-VolumesAdminNegativeTest-server-1228910078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-volumesadminnegativetest-server-1228910078',id=3,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4a85d5cd69b482e8742dec3d62015ff',ramdisk_id='',reservation_id='r-oezgzkge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-263954481',owner_user_name='tempest-VolumesAdminNegativeTest-263954481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:45Z,user_data=None,user_id='22f2a7dcc54e4df9bd2ae118f6c0943a',uuid=bec76c6e-db77-4b75-9c7c-31b738b93874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:47.696017 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Converting VIF {"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:47.696017 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:47.696017 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:47.696017 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:47.696017 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:47.696017 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:47.696666 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:47.696666 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4827f80f-66fe-5825-972b-e95b947d7508', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:47.704973 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:47.706429 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:47.709143 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:47.709388 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd27aa4e3-2f, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:47.709795 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd27aa4e3-2f, col_values=(('qos', UUID('738ad9e5-aaa8-4cff-8c7b-1163f18ff67d')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:47.710029 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd27aa4e3-2f, col_values=(('external_ids', {'iface-id': 'd27aa4e3-2f20-4457-97ec-31ed5e43738f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:fd:1e', 'vm-uuid': 'bec76c6e-db77-4b75-9c7c-31b738b93874'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:47.712841 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:47.716798 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:47.718105 np0000004364 nova-compute[98951]: INFO os_vif [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') Jul 03 04:17:47.791835 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:17:47.792225 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:47.792339 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Started (Lifecycle Event) Jul 03 04:17:47.840114 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Successfully updated port: a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:47.902072 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:47.956452 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:48.083079 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.089652 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.092129 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.110259 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.114649 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e33ed6c9-4741-4a37-afb8-7447a08e7b12 req-615c1b47-2f5b-48c4-9a58-0b1cd2d9d695 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:48.115100 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e33ed6c9-4741-4a37-afb8-7447a08e7b12 req-615c1b47-2f5b-48c4-9a58-0b1cd2d9d695 service nova] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:48.115291 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e33ed6c9-4741-4a37-afb8-7447a08e7b12 req-615c1b47-2f5b-48c4-9a58-0b1cd2d9d695 service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:48.115460 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e33ed6c9-4741-4a37-afb8-7447a08e7b12 req-615c1b47-2f5b-48c4-9a58-0b1cd2d9d695 service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:48.115621 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e33ed6c9-4741-4a37-afb8-7447a08e7b12 req-615c1b47-2f5b-48c4-9a58-0b1cd2d9d695 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] No event matching network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 in dict_keys([('network-vif-plugged', 'aff4956b-4a68-43c4-a12b-82169530ade7')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:17:48.115845 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-e33ed6c9-4741-4a37-afb8-7447a08e7b12 req-615c1b47-2f5b-48c4-9a58-0b1cd2d9d695 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received unexpected event network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 for instance with vm_state building and task_state spawning. Jul 03 04:17:48.118284 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.139650 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Updated VIF entry in instance network info cache for port d27aa4e3-2f20-4457-97ec-31ed5e43738f. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:17:48.139650 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Updating instance_info_cache with network_info: [{"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:48.299520 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:48.301778 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-changed-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:48.302645 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Refreshing instance network info cache due to event network-changed-a97a11c3-c2f8-42b8-bf85-08b12754ee60. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:48.303074 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] Acquiring lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:48.303213 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] Acquired lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:48.303375 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Refreshing network info cache for port a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:48.304497 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:48.304805 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Paused (Lifecycle Event) Jul 03 04:17:48.344384 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:48.413743 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.454s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:48.413743 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:48.418464 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.645s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:48.421889 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:48.422088 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Claim successful on node np0000004364 Jul 03 04:17:48.495140 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:48.496002 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:48.496464 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Creating image(s) Jul 03 04:17:48.496879 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "/opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:48.497061 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "/opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:48.497510 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "/opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:48.497784 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "e31daa9e1a7c7e0eb318a67f2d391b4fee787f69" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:48.498112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "e31daa9e1a7c7e0eb318a67f2d391b4fee787f69" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:48.642014 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d26d18ff-6db5-44aa-ae26-7add60d54608 req-e0def353-18e5-4e0f-9860-91410d9edf9f service nova] Releasing lock "refresh_cache-bec76c6e-db77-4b75-9c7c-31b738b93874" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:48.795350 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.805311 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.805869 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:48.808404 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:48.811810 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.816769 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:48.825413 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.832223 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:48.915563 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:48.923081 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:48.923081 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:48.923081 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:48.923284 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:49.139094 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13852c5a87aa4566850879e50e1779d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bbf86bcaa34d1fa4054c0afb4ac404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:49.242992 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:49.243460 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:49.243460 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] No VIF found with MAC fa:16:3e:b0:fd:1e, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:17:49.244128 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Using config drive Jul 03 04:17:49.272726 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:49.324105 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:17:49.336045 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:49.383102 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:49.385699 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:49.385987 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.part --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.426354 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:17:49.454231 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.part --force-share --output=json" returned: 0 in 0.068s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:49.455156 np0000004364 nova-compute[98951]: DEBUG nova.virt.images [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] 2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348 was qcow2, converting to raw {{(pid=98951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 03 04:17:49.455890 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:17:49.457164 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.part /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.converted {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.677988 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.part /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.converted" returned: 0 in 0.220s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:49.684403 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.converted --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.752285 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:49.754614 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69.converted --force-share --output=json" returned: 0 in 0.070s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:49.755145 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "e31daa9e1a7c7e0eb318a67f2d391b4fee787f69" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.257s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:49.755612 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:49.759008 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:49.761875 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.776828 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6f44255a-28ac-45c1-9348-71a91579c0de req-f71a5a46-ca3a-46d5-afc6-407026df3d33 service nova] Releasing lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:49.781692 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Successfully created port: 6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:49.788551 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquired lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:49.789189 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:49.832408 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69 --force-share --output=json" returned: 0 in 0.070s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:49.833150 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "e31daa9e1a7c7e0eb318a67f2d391b4fee787f69" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:49.833608 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "e31daa9e1a7c7e0eb318a67f2d391b4fee787f69" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:49.834569 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:49.837527 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:49.838172 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.869274 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:49.909167 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69 --force-share --output=json" returned: 0 in 0.070s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:49.909639 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69,backing_fmt=raw /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.938249 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:49.942360 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:49.942360 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:49.952817 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69,backing_fmt=raw /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk 1073741824" returned: 0 in 0.044s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:49.953343 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "e31daa9e1a7c7e0eb318a67f2d391b4fee787f69" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.120s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:49.953749 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:49.983567 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Creating config drive at /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk.config Jul 03 04:17:49.987540 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9rxp9r7m {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:50.019188 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e31daa9e1a7c7e0eb318a67f2d391b4fee787f69 --force-share --output=json" returned: 0 in 0.065s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:50.019682 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:50.019948 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:50.026203 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9rxp9r7m" returned: 0 in 0.038s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:50.103847 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:50.104710 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Cannot resize image /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:50.105019 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:50.105223 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Ensure instance console log exists: /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:50.105695 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.105860 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.106066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No event matching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 in dict_keys([('network-vif-plugged', '48061ba0-95c3-4156-9d02-bbcee76a06e5')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state building and task_state spawning. Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] No event matching network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f in dict_keys([('network-vif-plugged', 'd27aa4e3-2f20-4457-97ec-31ed5e43738f')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:17:50.244257 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received unexpected event network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f for instance with vm_state building and task_state spawning. Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-plugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Processing event network-vif-plugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-plugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.245112 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.245427 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.245427 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.245427 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] No waiting events found dispatching network-vif-plugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:17:50.245528 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received unexpected event network-vif-plugged-aff4956b-4a68-43c4-a12b-82169530ade7 for instance with vm_state building and task_state spawning. Jul 03 04:17:50.245784 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.246097 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Processing event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:17:50.247654 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state building and task_state spawning. Jul 03 04:17:50.248098 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.248098 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.248098 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.248098 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.248203 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] No waiting events found dispatching network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:17:50.248317 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ab69094e-5454-4887-9af4-fc4f66615c53 req-11c66197-ef1b-49f5-98e9-6637ae0daeca service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received unexpected event network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 for instance with vm_state building and task_state spawning. Jul 03 04:17:50.249321 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:50.249836 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:17:50.250860 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] VM Resumed (Lifecycle Event) Jul 03 04:17:50.251829 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:17:50.257134 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Instance spawned successfully. Jul 03 04:17:50.258183 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:17:50.260616 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:17:50.273733 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance spawned successfully. Jul 03 04:17:50.274611 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:17:50.368987 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:50.445659 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:50.482805 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.503816 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.549852 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Successfully updated port: 6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:50.619127 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-changed-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:50.619266 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Refreshing instance network info cache due to event network-changed-6dd00d98-7155-45e4-9f6f-c133145a9640. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:50.620109 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] Acquiring lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:50.620675 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] Acquired lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:50.620959 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Refreshing network info cache for port 6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:50.624606 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.643071 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:50.757065 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:50.761350 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:50.781189 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.781189 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.781814 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.781814 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.783148 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.783148 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.802362 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.802641 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.802881 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.803192 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.803503 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.803784 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:50.826449 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Updating instance_info_cache with network_info: [{"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:50.863626 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.868059 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.887715 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.888926 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:50.955976 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.539s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.956522 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:50.963814 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:50.965613 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.165s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.966181 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:50.966340 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Creating image(s) Jul 03 04:17:50.967050 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "/opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:50.967421 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "/opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:50.969671 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:50.970789 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Claim successful on node np0000004364 Jul 03 04:17:50.973183 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "/opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.006s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:50.974823 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:50.979318 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:50.980766 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:51.046422 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.065s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:51.046849 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:51.047302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:51.047798 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:51.050520 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:51.050881 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:51.059181 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:51.125195 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:51.134564 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.084s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:51.136238 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:51.164713 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk 1073741824" returned: 0 in 0.028s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:51.164713 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.117s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:51.164713 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:51.230618 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:51.237296 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.073s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:51.238377 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:51.238377 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:51.262871 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:17:51.263529 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:51.263529 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Resumed (Lifecycle Event) Jul 03 04:17:51.289663 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Took 14.13 seconds to spawn the instance on the hypervisor. Jul 03 04:17:51.293354 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:51.305464 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:51.308752 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Cannot resize image /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:51.308752 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:51.308752 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Ensure instance console log exists: /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:51.308752 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:51.308752 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:51.308752 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:51.316710 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Took 10.22 seconds to spawn the instance on the hypervisor. Jul 03 04:17:51.316958 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:51.329802 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Releasing lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:51.330196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Instance network_info: |[{"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:51.332361 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Start _get_guest_xml network_info=[{"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:17:33Z,direct_url=,disk_format='qcow2',id=2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348,min_disk=0,min_ram=0,name='',owner='5006f05e8ab44a05bb779d1ca677b454',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:17:35Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/sda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'scsi', 'image_id': '2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:51.334787 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:51.336212 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1603732213', uuid='29fd1525-8166-4498-b726-4199f68e7deb'), owner=OwnerMeta(userid='7587acb8e89c425d807e8875a9c8cc6b', username='tempest-AttachSCSIVolumeTestJSON-2080416413-project-member', projectid='879afb1507f042ebbf29d91b8c5289c9', projectname='tempest-AttachSCSIVolumeTestJSON-2080416413'), image=ImageMeta(id='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052271.335809) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:51.337232 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:51.337739 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:51.338483 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:51.338670 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:51.339865 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:51.340237 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:17:33Z,direct_url=,disk_format='qcow2',id=2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348,min_disk=0,min_ram=0,name='',owner='5006f05e8ab44a05bb779d1ca677b454',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:17:35Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:51.341295 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:51.341295 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:51.341295 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:51.341295 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:51.341295 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:51.341295 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:51.341577 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:51.341577 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:51.341747 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:51.341851 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:51.356102 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1603732213',display_name='tempest-AttachSCSIVolumeTestJSON-server-1603732213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachscsivolumetestjson-server-1603732213',id=4,image_ref='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvZi6hJObzlhiNZJw9ZmWC5JhwRMOxiYmCvDWqCTO62wV0PkjcGz+sVa1X0Pcf+oM/3IVD0Xz60UXinHk9ZUkxHOy+6tXlqv/A0ovI0/6NYshT5AXzRSfnbmAfxTxr4OQ==',key_name='tempest-keypair-172637224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879afb1507f042ebbf29d91b8c5289c9',ramdisk_id='',reservation_id='r-o8k64q4x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2080416413',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2080416413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7587acb8e89c425d807e8875a9c8cc6b',uuid=29fd1525-8166-4498-b726-4199f68e7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:51.356401 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Converting VIF {"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:51.357307 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:51.358108 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lazy-loading 'pci_devices' on Instance uuid 29fd1525-8166-4498-b726-4199f68e7deb {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:51.468837 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:51.469057 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:51.469511 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:51.469775 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:51.474555 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:51.564855 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9ba84ec8d8a40b6ae94d607151b7ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1828cb9b324d3daf261da0474ab91f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:51.769544 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:51.771960 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:51.801479 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Took 19.41 seconds to build instance. Jul 03 04:17:51.836198 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Took 15.55 seconds to build instance. Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] End _get_guest_xml xml= Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 29fd1525-8166-4498-b726-4199f68e7deb Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: instance-00000004 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: tempest-AttachSCSIVolumeTestJSON-server-1603732213 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 2026-07-03 04:17:51 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: True Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: bare Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: scsi Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: scsi Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: virtio-scsi Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: tempest-AttachSCSIVolumeTestJSON-2080416413-project-member Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: tempest-AttachSCSIVolumeTestJSON-2080416413 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 29fd1525-8166-4498-b726-4199f68e7deb Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 29fd1525-8166-4498-b726-4199f68e7deb Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]:
Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]:
Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: Jul 03 04:17:51.860889 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:51.862923 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Preparing to wait for external event network-vif-plugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:51.862923 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:51.862923 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:51.862923 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:51.862923 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1603732213',display_name='tempest-AttachSCSIVolumeTestJSON-server-1603732213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachscsivolumetestjson-server-1603732213',id=4,image_ref='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvZi6hJObzlhiNZJw9ZmWC5JhwRMOxiYmCvDWqCTO62wV0PkjcGz+sVa1X0Pcf+oM/3IVD0Xz60UXinHk9ZUkxHOy+6tXlqv/A0ovI0/6NYshT5AXzRSfnbmAfxTxr4OQ==',key_name='tempest-keypair-172637224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879afb1507f042ebbf29d91b8c5289c9',ramdisk_id='',reservation_id='r-o8k64q4x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2080416413',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2080416413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7587acb8e89c425d807e8875a9c8cc6b',uuid=29fd1525-8166-4498-b726-4199f68e7deb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:51.863143 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Converting VIF {"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:51.863143 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:51.863143 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:51.863498 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:51.863842 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:51.864127 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:51.864842 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:51.865035 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c030bef4-5c4e-580f-918f-0e2e854ddfce', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:51.867335 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:51.869062 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:51.869209 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa97a11c3-c2, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:51.869550 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa97a11c3-c2, col_values=(('qos', UUID('2efc57b7-4081-4666-a191-de0a58cb8294')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:51.869753 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa97a11c3-c2, col_values=(('external_ids', {'iface-id': 'a97a11c3-c2f8-42b8-bf85-08b12754ee60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b9:0e', 'vm-uuid': '29fd1525-8166-4498-b726-4199f68e7deb'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:51.871719 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:51.876118 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:51.877094 np0000004364 nova-compute[98951]: INFO os_vif [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') Jul 03 04:17:51.972719 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:17:51.978078 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-da47cf87-0aa3-47ec-908b-c331fc3b0b94 req-006353bf-ab67-4922-b613-11362109930c service nova] Releasing lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:51.978459 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquired lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:51.978632 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:52.191763 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Successfully created port: 1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:52.276442 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:52.276929 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] VM Started (Lifecycle Event) Jul 03 04:17:52.304257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-91031512-ea66-4032-86ce-06c3ccba9de5 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.922s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:52.317706 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-plugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:52.318063 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:52.318761 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:52.319242 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:52.319385 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Processing event network-vif-plugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:17:52.319550 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-plugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:52.319700 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:52.319841 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:52.320144 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:52.320202 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] No waiting events found dispatching network-vif-plugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:17:52.320293 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8363b9c8-d3e7-4262-9dbd-86d533a7f13f req-4e362819-cc76-4a41-b6f3-06801a3b3745 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received unexpected event network-vif-plugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f for instance with vm_state building and task_state spawning. Jul 03 04:17:52.321126 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:17:52.324581 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:17:52.327371 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Instance spawned successfully. Jul 03 04:17:52.327716 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:17:52.337878 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e0b15d45-d240-4908-bcfd-1da68f3ab443 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.060s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:52.456483 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:52.456695 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:52.475075 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:52.603929 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:52.781045 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:52.783599 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:52.787196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:52.840255 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:52.840255 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:52.840255 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:52.840255 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:52.840517 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:52.840623 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:52.892299 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Successfully updated port: 1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:52.960717 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:17:52.972317 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-changed-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:52.972589 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Refreshing instance network info cache due to event network-changed-1793304b-efe8-47f1-8d58-8af8edf0bc6c. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:52.973152 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] Acquiring lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:52.973302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] Acquired lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:52.973482 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Refreshing network info cache for port 1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:53.033182 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Updating instance_info_cache with network_info: [{"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:53.114763 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-changed-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:53.114931 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Refreshing instance network info cache due to event network-changed-48061ba0-95c3-4156-9d02-bbcee76a06e5. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:53.115259 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:53.115259 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:53.115353 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Refreshing network info cache for port 48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:53.290571 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:17:53.291072 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:53.291072 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] VM Paused (Lifecycle Event) Jul 03 04:17:53.345770 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Took 7.33 seconds to spawn the instance on the hypervisor. Jul 03 04:17:53.345934 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:53.397392 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:53.400581 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No BDM found with device name sda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:53.400784 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:53.402227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No VIF found with MAC fa:16:3e:88:b9:0e, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:17:53.402793 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Using config drive Jul 03 04:17:53.469476 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.505s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:53.469893 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:17:53.475452 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:53.490663 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:53.491630 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:53.491886 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Creating image(s) Jul 03 04:17:53.492291 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:53.492596 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "/opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:53.493091 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "/opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:53.494390 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:53.497617 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:53.499952 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:53.536105 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Releasing lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:53.536762 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Instance network_info: |[{"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:53.540762 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Start _get_guest_xml network_info=[{"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:53.543294 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:53.545757 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-2119366886', uuid='944f22bd-e9ac-4a28-8278-623847d01847'), owner=OwnerMeta(userid='13852c5a87aa4566850879e50e1779d3', username='tempest-VolumesAssistedSnapshotsTest-843449167-project-member', projectid='58bbf86bcaa34d1fa4054c0afb4ac404', projectname='tempest-VolumesAssistedSnapshotsTest-843449167'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052273.5449102) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:53.547204 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:53.547995 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:53.551682 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:53.553100 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:53.553528 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:53.553771 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:53.554055 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:53.554653 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:53.554935 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:53.580349 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2119366886',display_name='tempest-VolumesAssistedSnapshotsTest-server-2119366886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-volumesassistedsnapshotstest-server-2119366886',id=5,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLOoHJhM2Epb5Gb+/QANUdFLOKe0Twps1BU5SZn1Bwp3Kfvt0Bdryhv7smNAT0YH7GByOsh1KKyIIqLHOwoORAHlYT0N/7wSYy9RMCiAbQMZiq4miGRsVcJZI/d+ZiTeg==',key_name='tempest-keypair-730387864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58bbf86bcaa34d1fa4054c0afb4ac404',ramdisk_id='',reservation_id='r-fn7ea584',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-843449167',owner_user_name='tempest-VolumesAssistedSnapshotsTest-843449167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13852c5a87aa4566850879e50e1779d3',uuid=944f22bd-e9ac-4a28-8278-623847d01847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:53.580349 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Converting VIF {"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:53.582949 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:53.582949 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lazy-loading 'pci_devices' on Instance uuid 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:53.589520 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:53.592175 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.092s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:53.593434 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:53.593982 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:53.594496 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:53.600056 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:53.600535 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:53.618992 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:53.663185 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:53.663753 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:53.709527 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk 1073741824" returned: 0 in 0.045s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:53.710808 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.117s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:53.711285 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:53.795017 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.083s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:53.795413 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:53.795780 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:53.803311 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:53.811353 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:53.811958 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] VM Resumed (Lifecycle Event) Jul 03 04:17:53.828554 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:53.856137 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Took 12.78 seconds to build instance. Jul 03 04:17:53.862279 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:53.862699 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Cannot resize image /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:53.863521 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:53.863521 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Ensure instance console log exists: /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:53.863637 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:53.864165 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:53.864347 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:53.910577 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:53.976819 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:17:53.977210 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:17:53.977446 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:53.977628 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:54.039487 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Creating config drive at /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk.config Jul 03 04:17:54.044044 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9adrs8v1 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:54.077124 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9adrs8v1" returned: 0 in 0.033s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:54.086213 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9ba84ec8d8a40b6ae94d607151b7ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1828cb9b324d3daf261da0474ab91f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:17:54.095316 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] End _get_guest_xml xml= Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 944f22bd-e9ac-4a28-8278-623847d01847 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: instance-00000005 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: tempest-VolumesAssistedSnapshotsTest-server-2119366886 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 2026-07-03 04:17:53 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: True Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: bare Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: virtio Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: tempest-VolumesAssistedSnapshotsTest-843449167-project-member Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: tempest-VolumesAssistedSnapshotsTest-843449167 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 944f22bd-e9ac-4a28-8278-623847d01847 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 944f22bd-e9ac-4a28-8278-623847d01847 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: Jul 03 04:17:54.100732 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:54.103177 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Preparing to wait for external event network-vif-plugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:54.103177 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:54.103177 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:54.103309 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:54.104233 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2119366886',display_name='tempest-VolumesAssistedSnapshotsTest-server-2119366886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-volumesassistedsnapshotstest-server-2119366886',id=5,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLOoHJhM2Epb5Gb+/QANUdFLOKe0Twps1BU5SZn1Bwp3Kfvt0Bdryhv7smNAT0YH7GByOsh1KKyIIqLHOwoORAHlYT0N/7wSYy9RMCiAbQMZiq4miGRsVcJZI/d+ZiTeg==',key_name='tempest-keypair-730387864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58bbf86bcaa34d1fa4054c0afb4ac404',ramdisk_id='',reservation_id='r-fn7ea584',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-843449167',owner_user_name='tempest-VolumesAssistedSnapshotsTest-843449167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13852c5a87aa4566850879e50e1779d3',uuid=944f22bd-e9ac-4a28-8278-623847d01847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:54.104459 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Converting VIF {"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:54.105202 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:54.105497 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:54.106135 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.106526 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:54.106802 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:54.107685 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.109339 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c981293-3bcb-51bd-905d-f69177d8dd15', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:54.110364 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.111553 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:54.117961 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.121265 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.121479 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dd00d98-71, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:54.121863 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6dd00d98-71, col_values=(('qos', UUID('496e4f3b-de51-4bc3-bb2b-9681ac81252e')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:54.122016 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6dd00d98-71, col_values=(('external_ids', {'iface-id': '6dd00d98-7155-45e4-9f6f-c133145a9640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:da:c5', 'vm-uuid': '944f22bd-e9ac-4a28-8278-623847d01847'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:54.125589 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:54.135212 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.136384 np0000004364 nova-compute[98951]: INFO os_vif [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') Jul 03 04:17:54.292029 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updated VIF entry in instance network info cache for port 48061ba0-95c3-4156-9d02-bbcee76a06e5. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:17:54.292591 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:54.318196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:54.319527 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:54.331248 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d24c8946-5537-4341-8719-1e9e9426ddfc req-e4d00fe8-1074-4cea-aeb2-f619bd55f17f service nova] Releasing lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:54.332237 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquired lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:54.332491 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:54.358950 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fdbed7fc-2aad-430a-b726-70de72c662dd tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.292s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:54.479493 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:17:54.575975 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.604262 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.628240 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Successfully created port: 0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:17:54.715241 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.795154 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8dd68740-6e8d-4459-805d-90a47b29a35c req-2383ade6-5ae6-4c5d-95c2-d579160ec0e7 service nova] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:54.844647 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-418e0b81-518b-49d2-8402-6a79b0419c79 req-3c591d7f-08c3-4ad2-a9ab-f1645fc84e55 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-plugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:54.844846 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-418e0b81-518b-49d2-8402-6a79b0419c79 req-3c591d7f-08c3-4ad2-a9ab-f1645fc84e55 service nova] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:54.845024 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-418e0b81-518b-49d2-8402-6a79b0419c79 req-3c591d7f-08c3-4ad2-a9ab-f1645fc84e55 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:54.845150 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-418e0b81-518b-49d2-8402-6a79b0419c79 req-3c591d7f-08c3-4ad2-a9ab-f1645fc84e55 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:54.845283 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-418e0b81-518b-49d2-8402-6a79b0419c79 req-3c591d7f-08c3-4ad2-a9ab-f1645fc84e55 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Processing event network-vif-plugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:17:54.871143 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.951677 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:54.957392 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:54.962617 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.967795 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:54.983069 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:17:54.999055 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:55.010802 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:55.177954 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:55.385824 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Successfully updated port: 0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:17:55.405034 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Updating instance_info_cache with network_info: [{"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:55.454192 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-changed-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:55.456743 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Refreshing instance network info cache due to event network-changed-0d57f313-fcff-42ac-a3c3-e0139470d053. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:55.458073 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] Acquiring lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:55.458216 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] Acquired lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:55.458401 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Refreshing network info cache for port 0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:55.464938 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] instance snapshotting Jul 03 04:17:55.570106 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Beginning live snapshot process Jul 03 04:17:55.657479 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:55.657479 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:55.657479 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] No VIF found with MAC fa:16:3e:66:da:c5, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:17:55.657479 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Using config drive Jul 03 04:17:55.665631 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:17:55.665981 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:55.666104 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] VM Started (Lifecycle Event) Jul 03 04:17:55.668767 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:17:55.673497 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Instance spawned successfully. Jul 03 04:17:55.673836 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:17:55.677904 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:55.678287 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:55.679968 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:55.679968 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:55.890674 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:55.907168 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Releasing lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:55.907504 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Instance network_info: |[{"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:55.909026 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Start _get_guest_xml network_info=[{"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:55.911118 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:55.911957 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1625861040-1', uuid='c3e4ef2d-c122-479f-9d8c-af3a8725cb22'), owner=OwnerMeta(userid='d9ba84ec8d8a40b6ae94d607151b7ae2', username='tempest-TestMultiAttachVolumeSwap-1858351913-project-member', projectid='1f1828cb9b324d3daf261da0474ab91f', projectname='tempest-TestMultiAttachVolumeSwap-1858351913'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052275.911584) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:55.913850 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:55.914785 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:55.914785 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:55.915678 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:55.916206 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:55.916206 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:55.916438 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:55.916438 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:55.916896 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:55.916896 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:55.916896 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:55.916896 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:55.916896 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:55.917183 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:55.917183 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:55.917364 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:55.927176 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1625861040-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-testmultiattachvolumeswap-server-1625861040-1',id=6,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtLYQDHUGHqVcQw5upb07xhQqeRAwI70kMEJPLJuvzYpnlESJBJUWrhbqCdnzeHPjcKJKdfGub02LoeHJIY4MKHWJyyCab2VAjwjOv3d+potreXzKWYKeutJitAIRIHAg==',key_name='tempest-keypair-1667604087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f1828cb9b324d3daf261da0474ab91f',ramdisk_id='',reservation_id='r-zachrkr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1858351913',owner_user_name='tempest-TestMultiAttachVolumeSwap-1858351913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba84ec8d8a40b6ae94d607151b7ae2',uuid=c3e4ef2d-c122-479f-9d8c-af3a8725cb22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:55.927388 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converting VIF {"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:55.927959 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:55.928422 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'pci_devices' on Instance uuid c3e4ef2d-c122-479f-9d8c-af3a8725cb22 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:55.960791 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:55.997509 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:17:55.999759 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:17:55.999897 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Creating image(s) Jul 03 04:17:56.000432 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "/opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:56.000743 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "/opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:56.004720 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "/opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.004s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:56.005824 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:56.009493 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:56.013251 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:56.045863 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:56.082773 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.072s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:56.083190 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:56.083916 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:56.084511 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:56.087687 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:56.088049 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:56.167764 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:56.170204 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.082s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:56.170791 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:56.171378 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:56.182960 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:56.192235 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Took 7.69 seconds to spawn the instance on the hypervisor. Jul 03 04:17:56.192235 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:56.212693 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk 1073741824" returned: 0 in 0.041s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:56.213118 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.129s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:56.214218 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:56.298004 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:56.313975 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.100s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:56.314555 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:17:56.315735 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:56.388094 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:56.388855 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Cannot resize image /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:17:56.389713 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:17:56.390290 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Ensure instance console log exists: /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:17:56.391938 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:56.392508 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:56.392812 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:56.400284 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Creating config drive at /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk.config Jul 03 04:17:56.401838 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9w13hck {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] End _get_guest_xml xml= Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: c3e4ef2d-c122-479f-9d8c-af3a8725cb22 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: instance-00000006 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: tempest-TestMultiAttachVolumeSwap-server-1625861040-1 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 2026-07-03 04:17:55 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: True Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: bare Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: virtio Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: tempest-TestMultiAttachVolumeSwap-1858351913-project-member Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: tempest-TestMultiAttachVolumeSwap-1858351913 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: c3e4ef2d-c122-479f-9d8c-af3a8725cb22 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: c3e4ef2d-c122-479f-9d8c-af3a8725cb22 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: Jul 03 04:17:56.433483 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:56.436166 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Preparing to wait for external event network-vif-plugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:56.436166 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:56.436166 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:56.436166 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:56.436166 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1625861040-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-testmultiattachvolumeswap-server-1625861040-1',id=6,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtLYQDHUGHqVcQw5upb07xhQqeRAwI70kMEJPLJuvzYpnlESJBJUWrhbqCdnzeHPjcKJKdfGub02LoeHJIY4MKHWJyyCab2VAjwjOv3d+potreXzKWYKeutJitAIRIHAg==',key_name='tempest-keypair-1667604087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f1828cb9b324d3daf261da0474ab91f',ramdisk_id='',reservation_id='r-zachrkr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1858351913',owner_user_name='tempest-TestMultiAttachVolumeSwap-1858351913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba84ec8d8a40b6ae94d607151b7ae2',uuid=c3e4ef2d-c122-479f-9d8c-af3a8725cb22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:56.436558 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converting VIF {"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:56.437250 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:56.437641 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:56.438271 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:56.439734 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:56.439734 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:56.442060 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:56.442060 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c81d95d9-fb93-5709-87b7-f0532232b21d', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:56.443420 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:56.446710 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9w13hck" returned: 0 in 0.045s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:56.452946 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:56.455486 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:56.455602 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1793304b-ef, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:56.456609 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1793304b-ef, col_values=(('qos', UUID('922136e4-929d-47a1-9779-cc5772d2e3cb')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:56.456932 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1793304b-ef, col_values=(('external_ids', {'iface-id': '1793304b-efe8-47f1-8d58-8af8edf0bc6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:3b:67', 'vm-uuid': 'c3e4ef2d-c122-479f-9d8c-af3a8725cb22'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:56.459818 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:56.471702 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:56.473319 np0000004364 nova-compute[98951]: INFO os_vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') Jul 03 04:17:56.691984 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:17:56.692458 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:56.692633 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] VM Paused (Lifecycle Event) Jul 03 04:17:56.709815 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Took 14.61 seconds to build instance. Jul 03 04:17:56.801605 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-dbf5f01e-0525-48f5-ae98-01b9d704939b req-e75caa7f-5d13-4166-8522-ca98c9079662 service nova] Releasing lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:56.802240 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquired lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:56.803446 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:17:56.927210 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:56.939568 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-5360c287-8f42-4c44-b006-25571712bb09 req-4746da92-4d75-4cde-9976-1fc004f4ff98 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-plugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:56.939568 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5360c287-8f42-4c44-b006-25571712bb09 req-4746da92-4d75-4cde-9976-1fc004f4ff98 service nova] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:56.939568 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5360c287-8f42-4c44-b006-25571712bb09 req-4746da92-4d75-4cde-9976-1fc004f4ff98 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:56.939568 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5360c287-8f42-4c44-b006-25571712bb09 req-4746da92-4d75-4cde-9976-1fc004f4ff98 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:56.941743 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-5360c287-8f42-4c44-b006-25571712bb09 req-4746da92-4d75-4cde-9976-1fc004f4ff98 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] No waiting events found dispatching network-vif-plugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:17:56.941743 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-5360c287-8f42-4c44-b006-25571712bb09 req-4746da92-4d75-4cde-9976-1fc004f4ff98 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received unexpected event network-vif-plugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 for instance with vm_state active and task_state None. Jul 03 04:17:56.955540 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.006474 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:57.006688 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:57.063143 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.089006 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json -f qcow2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:57.146234 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-5be0e9ca-98e9-4b0b-80ba-5df47f26a2be req-29044464-b615-4b5c-9c89-d311bf360ae3 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-plugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:57.146754 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5be0e9ca-98e9-4b0b-80ba-5df47f26a2be req-29044464-b615-4b5c-9c89-d311bf360ae3 service nova] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:57.147053 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5be0e9ca-98e9-4b0b-80ba-5df47f26a2be req-29044464-b615-4b5c-9c89-d311bf360ae3 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:57.147235 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5be0e9ca-98e9-4b0b-80ba-5df47f26a2be req-29044464-b615-4b5c-9c89-d311bf360ae3 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:57.147412 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-5be0e9ca-98e9-4b0b-80ba-5df47f26a2be req-29044464-b615-4b5c-9c89-d311bf360ae3 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Processing event network-vif-plugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:17:57.179361 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:57.180121 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json -f qcow2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:57.197715 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:57.201879 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:57.203259 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] VM Resumed (Lifecycle Event) Jul 03 04:17:57.211946 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-39c537e2-360b-4f5d-a235-6bf38db70b73 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.121s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:57.281838 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:57.282505 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:57.285684 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:17:57.285837 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:57.297576 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.313447 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.330657 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.342435 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.386968 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.100s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:57.386968 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptq82vz9a/65bc43cbaec34be3a8444920452c6c97.delta 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:57.428129 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptq82vz9a/65bc43cbaec34be3a8444920452c6c97.delta 1073741824" returned: 0 in 0.040s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:57.428129 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Quiescing instance not available: QEMU guest agent is not enabled. Jul 03 04:17:57.437099 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:57.445038 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:17:57.509869 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:17:57.697989 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:57.706865 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:57.714856 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:57.735670 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 03 04:17:57.737452 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 03 04:17:57.789510 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:17:57.789853 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptq82vz9a/65bc43cbaec34be3a8444920452c6c97.delta /opt/stack/data/nova/instances/snapshots/tmptq82vz9a/65bc43cbaec34be3a8444920452c6c97 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:57.870751 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updating instance_info_cache with network_info: [{"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:17:57.914300 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptq82vz9a/65bc43cbaec34be3a8444920452c6c97.delta /opt/stack/data/nova/instances/snapshots/tmptq82vz9a/65bc43cbaec34be3a8444920452c6c97" returned: 0 in 0.124s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:57.914899 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Snapshot extracted, beginning image upload Jul 03 04:17:57.934876 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:17:57.937398 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:17:57.939658 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Instance spawned successfully. Jul 03 04:17:57.940178 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:17:57.998215 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:57.998215 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:17:57.998215 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No VIF found with MAC fa:16:3e:76:3b:67, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:17:57.998215 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Using config drive Jul 03 04:17:58.095964 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:58.096200 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:58.099037 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:17:58.099247 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Claim successful on node np0000004364 Jul 03 04:17:58.217435 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:58.217581 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] VM Started (Lifecycle Event) Jul 03 04:17:58.374299 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Releasing lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:17:58.374299 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Instance network_info: |[{"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:17:58.375964 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Start _get_guest_xml network_info=[{"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:17:58.377538 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:17:58.378626 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1625861040-2', uuid='e60c0794-599a-4409-8806-ee2697a55a78'), owner=OwnerMeta(userid='d9ba84ec8d8a40b6ae94d607151b7ae2', username='tempest-TestMultiAttachVolumeSwap-1858351913-project-member', projectid='1f1828cb9b324d3daf261da0474ab91f', projectname='tempest-TestMultiAttachVolumeSwap-1858351913'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052278.3782992) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:17:58.379424 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:17:58.379801 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:17:58.380545 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:17:58.380688 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:17:58.381546 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:17:58.381846 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:17:58.382020 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:17:58.382143 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:17:58.382281 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:17:58.382415 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:17:58.382546 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:17:58.382645 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:17:58.382746 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:17:58.382884 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:17:58.382991 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:17:58.383143 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:17:58.394671 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1625861040-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-testmultiattachvolumeswap-server-1625861040-2',id=7,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtLYQDHUGHqVcQw5upb07xhQqeRAwI70kMEJPLJuvzYpnlESJBJUWrhbqCdnzeHPjcKJKdfGub02LoeHJIY4MKHWJyyCab2VAjwjOv3d+potreXzKWYKeutJitAIRIHAg==',key_name='tempest-keypair-1667604087',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f1828cb9b324d3daf261da0474ab91f',ramdisk_id='',reservation_id='r-zachrkr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1858351913',owner_user_name='tempest-TestMultiAttachVolumeSwap-1858351913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba84ec8d8a40b6ae94d607151b7ae2',uuid=e60c0794-599a-4409-8806-ee2697a55a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:17:58.394929 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converting VIF {"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:58.395502 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:58.396013 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'pci_devices' on Instance uuid e60c0794-599a-4409-8806-ee2697a55a78 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:58.447898 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:58.448466 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:58.448898 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:58.449251 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:58.449601 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:58.449972 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:17:58.471134 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:58.471435 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:58.471617 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:58.473189 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:58.473385 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:58.476712 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Terminating instance Jul 03 04:17:58.508041 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:58.722832 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:58.725305 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:17:58.742034 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Creating config drive at /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk.config Jul 03 04:17:58.747939 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjc8ipv7z {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:17:58.777961 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjc8ipv7z" returned: 0 in 0.030s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] End _get_guest_xml xml= Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: e60c0794-599a-4409-8806-ee2697a55a78 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: instance-00000007 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 196608 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: tempest-TestMultiAttachVolumeSwap-server-1625861040-2 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 2026-07-03 04:17:58 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 192 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: True Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: bare Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 0 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: virtio Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: tempest-TestMultiAttachVolumeSwap-1858351913-project-member Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: tempest-TestMultiAttachVolumeSwap-1858351913 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: e60c0794-599a-4409-8806-ee2697a55a78 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: e60c0794-599a-4409-8806-ee2697a55a78 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: hvm Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 128 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: 1 Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: Jul 03 04:17:58.900594 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:17:58.903255 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Preparing to wait for external event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:17:58.903255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:58.903255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:58.903255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:58.903255 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1625861040-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-testmultiattachvolumeswap-server-1625861040-2',id=7,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtLYQDHUGHqVcQw5upb07xhQqeRAwI70kMEJPLJuvzYpnlESJBJUWrhbqCdnzeHPjcKJKdfGub02LoeHJIY4MKHWJyyCab2VAjwjOv3d+potreXzKWYKeutJitAIRIHAg==',key_name='tempest-keypair-1667604087',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f1828cb9b324d3daf261da0474ab91f',ramdisk_id='',reservation_id='r-zachrkr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1858351913',owner_user_name='tempest-TestMultiAttachVolumeSwap-1858351913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba84ec8d8a40b6ae94d607151b7ae2',uuid=e60c0794-599a-4409-8806-ee2697a55a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:17:58.903623 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converting VIF {"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:17:58.903623 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:17:58.903623 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:17:58.904484 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:58.905391 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:58.905391 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:17:58.907429 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:58.907429 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1aa2b1e-0eb7-5d81-8475-c1be1a24e3f8', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:58.908377 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:58.914532 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:58.917030 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:58.917302 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d57f313-fc, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:58.917784 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d57f313-fc, col_values=(('qos', UUID('c1527ab4-b6b9-4115-b2f7-1c59163fb3a6')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:58.918051 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d57f313-fc, col_values=(('external_ids', {'iface-id': '0d57f313-fcff-42ac-a3c3-e0139470d053', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:92:48', 'vm-uuid': 'e60c0794-599a-4409-8806-ee2697a55a78'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:17:58.920617 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:58.922712 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:17:58.937256 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:58.938352 np0000004364 nova-compute[98951]: INFO os_vif [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') Jul 03 04:17:58.960653 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Took 8.00 seconds to spawn the instance on the hypervisor. Jul 03 04:17:58.960858 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:58.984352 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:17:59.011694 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-changed-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:59.013696 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Refreshing instance network info cache due to event network-changed-a97a11c3-c2f8-42b8-bf85-08b12754ee60. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:17:59.013937 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] Acquiring lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:17:59.014071 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] Acquired lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:17:59.014251 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Refreshing network info cache for port a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:17:59.021599 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.040860 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.044039 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.048343 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.080641 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.230675 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:17:59.230943 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:59.231097 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] VM Paused (Lifecycle Event) Jul 03 04:17:59.241719 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6d41951a-47fa-44b9-a0e5-e659e2a0dc9f req-c6b3a11f-8f85-4ec1-961b-7939bb709f26 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-plugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:17:59.241719 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6d41951a-47fa-44b9-a0e5-e659e2a0dc9f req-c6b3a11f-8f85-4ec1-961b-7939bb709f26 service nova] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:17:59.241719 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6d41951a-47fa-44b9-a0e5-e659e2a0dc9f req-c6b3a11f-8f85-4ec1-961b-7939bb709f26 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:17:59.241719 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6d41951a-47fa-44b9-a0e5-e659e2a0dc9f req-c6b3a11f-8f85-4ec1-961b-7939bb709f26 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:17:59.241719 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6d41951a-47fa-44b9-a0e5-e659e2a0dc9f req-c6b3a11f-8f85-4ec1-961b-7939bb709f26 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] No waiting events found dispatching network-vif-plugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:17:59.241719 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-6d41951a-47fa-44b9-a0e5-e659e2a0dc9f req-c6b3a11f-8f85-4ec1-961b-7939bb709f26 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received unexpected event network-vif-plugged-6dd00d98-7155-45e4-9f6f-c133145a9640 for instance with vm_state active and task_state None. Jul 03 04:17:59.312281 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.353927 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.412345 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.453633 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.462958 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.485017 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Took 16.72 seconds to build instance. Jul 03 04:17:59.491574 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.518161 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:17:59.605193 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.605309 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Instance destroyed successfully. Jul 03 04:17:59.606789 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lazy-loading 'resources' on Instance uuid bec76c6e-db77-4b75-9c7c-31b738b93874 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:17:59.729540 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.731677 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:17:59.732400 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:17:59.734471 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:17:59.741529 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:17:59.742406 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] VM Resumed (Lifecycle Event) Jul 03 04:17:59.744017 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.777033 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.792042 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.839112 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.874351 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:17:59.987962 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2f51148-bbbf-42b8-8ac6-4baa27639795 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.229s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:00.011789 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:00.109475 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1228910078',display_name='tempest-VolumesAdminNegativeTest-server-1228910078',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-volumesadminnegativetest-server-1228910078',id=3,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:17:53Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f4a85d5cd69b482e8742dec3d62015ff',ramdisk_id='',reservation_id='r-oezgzkge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-263954481',owner_user_name='tempest-VolumesAdminNegativeTest-263954481-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:17:53Z,user_data=None,user_id='22f2a7dcc54e4df9bd2ae118f6c0943a',uuid=bec76c6e-db77-4b75-9c7c-31b738b93874,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:18:00.109703 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Converting VIF {"id": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "address": "fa:16:3e:b0:fd:1e", "network": {"id": "7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1738880374-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4a85d5cd69b482e8742dec3d62015ff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd27aa4e3-2f", "ovs_interfaceid": "d27aa4e3-2f20-4457-97ec-31ed5e43738f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:00.110431 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:00.110632 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:18:00.114191 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:00.114489 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd27aa4e3-2f, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:00.118612 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:00.119479 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:00.123807 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:00.124996 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:00.125274 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=738ad9e5-aaa8-4cff-8c7b-1163f18ff67d) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:00.126506 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:00.127372 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:00.136418 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:00.138995 np0000004364 nova-compute[98951]: INFO os_vif [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:fd:1e,bridge_name='br-int',has_traffic_filtering=True,id=d27aa4e3-2f20-4457-97ec-31ed5e43738f,network=Network(7ba2412e-75d2-4edc-9279-ff6bc5ccc5cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd27aa4e3-2f') Jul 03 04:18:00.139370 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Deleting instance files /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874_del Jul 03 04:18:00.140030 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Deletion of /opt/stack/data/nova/instances/bec76c6e-db77-4b75-9c7c-31b738b93874_del complete Jul 03 04:18:00.160639 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Updated VIF entry in instance network info cache for port a97a11c3-c2f8-42b8-bf85-08b12754ee60. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:18:00.160950 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Updating instance_info_cache with network_info: [{"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:00.236480 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:00.249688 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:00.257557 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:00.429455 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-075603df-0aa8-44b1-b3f7-4ad31d4a0c5a req-262ecd08-9a3f-47ca-884f-e2bc8a0ea654 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:00.429644 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-075603df-0aa8-44b1-b3f7-4ad31d4a0c5a req-262ecd08-9a3f-47ca-884f-e2bc8a0ea654 service nova] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:00.429878 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-075603df-0aa8-44b1-b3f7-4ad31d4a0c5a req-262ecd08-9a3f-47ca-884f-e2bc8a0ea654 service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:00.430036 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-075603df-0aa8-44b1-b3f7-4ad31d4a0c5a req-262ecd08-9a3f-47ca-884f-e2bc8a0ea654 service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:00.430196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-075603df-0aa8-44b1-b3f7-4ad31d4a0c5a req-262ecd08-9a3f-47ca-884f-e2bc8a0ea654 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] No waiting events found dispatching network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:00.430361 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-075603df-0aa8-44b1-b3f7-4ad31d4a0c5a req-262ecd08-9a3f-47ca-884f-e2bc8a0ea654 service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:00.469647 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:00.470190 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:00.470190 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No VIF found with MAC fa:16:3e:d3:92:48, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:00.470522 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Using config drive Jul 03 04:18:00.645903 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Took 1.66 seconds to destroy the instance on the hypervisor. Jul 03 04:18:00.646508 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:18:00.646751 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:18:00.646859 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:18:00.647130 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:00.663367 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6cf140aa-8349-415f-bca5-52a3bc5257c8 req-29710f0a-4d01-4570-968a-1b735b07317f service nova] Releasing lock "refresh_cache-29fd1525-8166-4498-b726-4199f68e7deb" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:00.745770 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.649s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:00.746144 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:18:00.752066 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:00.760256 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999377564000042 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:00.760475 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999101736000057 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:00.760580 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99897755699999 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:00.761029 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:00.761184 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] VM Started (Lifecycle Event) Jul 03 04:18:00.978167 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:01.014949 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-changed-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:01.015288 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Refreshing instance network info cache due to event network-changed-6dd00d98-7155-45e4-9f6f-c133145a9640. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:01.015479 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] Acquiring lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:01.015601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] Acquired lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:01.015780 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Refreshing network info cache for port 6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:01.172350 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Creating config drive at /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk.config Jul 03 04:18:01.176983 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpax2aprpa {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:01.210295 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpax2aprpa" returned: 0 in 0.033s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:01.255192 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:18:01.255657 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:18:01.257196 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:01.257569 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:01.265303 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:01.279088 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:01.279232 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] VM Paused (Lifecycle Event) Jul 03 04:18:01.494037 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18ba934fdb74408791fccc735ddf0237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8018e37ae1254f68bfa475fb7625949c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:18:01.519420 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:01.557546 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Snapshot image upload complete Jul 03 04:18:01.557787 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-20085543-c9bc-4913-9011-6b24dc430966 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Took 6.09 seconds to snapshot the instance on the hypervisor. Jul 03 04:18:01.709968 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:01.741646 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:01.760467 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:18:01.782162 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:01.786981 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:01.877894 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:01.899442 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:01.901536 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:01.998262 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:02.132150 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully created port: fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:02.290285 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Updated VIF entry in instance network info cache for port 6dd00d98-7155-45e4-9f6f-c133145a9640. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:18:02.290745 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Updating instance_info_cache with network_info: [{"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:02.292203 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:02.352309 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:02.510130 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:02.510973 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] Acquiring lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:02.511214 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:02.511364 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:02.511471 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] No waiting events found dispatching network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:02.511598 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-unplugged-d27aa4e3-2f20-4457-97ec-31ed5e43738f for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:02.511716 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cd68bc38-b1df-49e1-a933-182cda493316 req-2a875f14-85d2-4256-a2a2-93cedbdf59eb service nova] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Received event network-vif-deleted-d27aa4e3-2f20-4457-97ec-31ed5e43738f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:02.625394 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully created port: 29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:02.769352 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:02.769480 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] VM Started (Lifecycle Event) Jul 03 04:18:02.794487 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-572b7fe3-30fe-4bd5-8e10-ce41e61bf9d4 req-a6fa7436-101c-4cb7-b747-af1ac2a3e29a service nova] Releasing lock "refresh_cache-944f22bd-e9ac-4a28-8278-623847d01847" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:02.848177 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:02.848446 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:02.855382 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Took 2.21 seconds to deallocate network for instance. Jul 03 04:18:03.272137 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:18:03.276589 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:03.284941 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:03.285143 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] VM Paused (Lifecycle Event) Jul 03 04:18:03.351378 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:18:03.363993 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:03.366627 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:03.482110 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully created port: 19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:03.780771 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Booting with volume 7dac5ac5-7275-4620-ba08-d3ff61711cf9 at /dev/vda Jul 03 04:18:03.787865 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:03.789968 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:03.846957 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:03.848246 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp03w7te7m/privsep.sock'] Jul 03 04:18:03.856940 np0000004364 sudo[112057]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp03w7te7m/privsep.sock Jul 03 04:18:03.857829 np0000004364 sudo[112057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 04:18:03.914970 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:03.914970 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:03.925254 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:03.974814 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully created port: 8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:04.150776 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 04:18:04.150918 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 04:18:04.150918 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 04:18:04.151349 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:18:04.151349 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 04:18:04.151349 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 04:18:04.151349 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 04:18:04.151349 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:18:04.151494 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 04:18:04.292421 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:04.412455 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully created port: adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:04.418910 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:04.449817 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 04:18:04.449998 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 04:18:04.449998 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 04:18:04.449998 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:18:04.450132 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 04:18:04.450132 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 04:18:04.450211 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 04:18:04.450211 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 04:18:04.450279 np0000004364 nova-compute[98951]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 04:18:04.584581 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:04.584836 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:04.668566 np0000004364 sudo[112057]: pam_unix(sudo:session): session closed for user root Jul 03 04:18:04.670076 np0000004364 nova-compute[98951]: INFO oslo.privsep.daemon [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Spawned new privsep daemon via rootwrap Jul 03 04:18:04.779279 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:04.779745 np0000004364 nova-compute[98951]: WARNING os_brick.initiator.connectors.nvmeof [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jul 03 04:18:04.798167 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:04.816737 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:04.817070 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:04.826627 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:04.828679 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248'] Jul 03 04:18:04.828939 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:04.829097 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:04.829890 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== get_connector_properties: return (982ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:04.830204 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating existing volume attachment record: dad20ac7-d9ca-406d-8d8f-ef9fb6f3e18e {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:04.876356 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:04.926301 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.560s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:04.928589 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.004s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:04.932415 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:18:04.932674 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Claim successful on node np0000004364 Jul 03 04:18:05.002884 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Deleted allocations for instance bec76c6e-db77-4b75-9c7c-31b738b93874 Jul 03 04:18:05.011623 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:05.063705 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:05.065372 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-fe950017-4bf0-4122-ac89-ebd512e7c5ba. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:05.066582 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:05.066764 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:05.066929 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:05.086820 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:18:05.126998 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:05.572412 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:05.655900 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:05.659973 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:05.841536 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:06.012272 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a1931e19-c223-4b5c-b8dd-afd01e2d7e1a tempest-VolumesAdminNegativeTest-263954481 tempest-VolumesAdminNegativeTest-263954481-project-member] Lock "bec76c6e-db77-4b75-9c7c-31b738b93874" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.541s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:06.133169 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: 990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:06.199900 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:06.200127 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-990dad4f-21fa-472f-bf2e-4d119a9720ce. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:06.200239 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:06.294257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-41d0f5db-8f41-4786-9cbe-8f5c425d72b8 req-8bd53cd6-b814-410e-a12a-31ae83acbe2b service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-plugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:06.294836 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-41d0f5db-8f41-4786-9cbe-8f5c425d72b8 req-8bd53cd6-b814-410e-a12a-31ae83acbe2b service nova] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:06.295463 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-41d0f5db-8f41-4786-9cbe-8f5c425d72b8 req-8bd53cd6-b814-410e-a12a-31ae83acbe2b service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:06.295605 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-41d0f5db-8f41-4786-9cbe-8f5c425d72b8 req-8bd53cd6-b814-410e-a12a-31ae83acbe2b service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:06.295751 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-41d0f5db-8f41-4786-9cbe-8f5c425d72b8 req-8bd53cd6-b814-410e-a12a-31ae83acbe2b service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Processing event network-vif-plugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:06.296136 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:18:06.300000 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:06.300190 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] VM Resumed (Lifecycle Event) Jul 03 04:18:06.303209 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:18:06.306261 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Instance spawned successfully. Jul 03 04:18:06.306770 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:18:06.343786 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e697b5ea-43d6-4be0-a9e5-438e778ef407 req-df5abe0f-f014-4f3c-98db-10fc1e097fbf service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:06.344215 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:06.344446 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port 990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:06.459563 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Booting with volume f3124766-0a3c-47a2-843c-c0bee03dfe51 at /dev/vdb Jul 03 04:18:06.473878 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:06.474132 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:06.517515 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:06.529956 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:06.550584 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:06.574258 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:06.574717 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:06.584926 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:06.586533 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248'] Jul 03 04:18:06.586745 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:06.587907 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:06.588142 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:06.588480 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating existing volume attachment record: 77a01be7-ebac-41eb-bc9a-b4768ab42b78 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:06.805490 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:06.806907 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:06.814272 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:06.814272 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:06.814790 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:06.815395 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:06.815395 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:06.816459 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:06.849529 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:06.973534 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:06.980012 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:07.155237 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:07.294993 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: 362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:07.312059 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:07.321278 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Took 13.83 seconds to spawn the instance on the hypervisor. Jul 03 04:18:07.321278 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:07.366045 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:07.366473 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-362342a9-83a3-4b70-a87b-9f6857c94d27. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:07.368289 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:07.488891 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.560s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:07.489678 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.830s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:07.489881 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:18:07.493947 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:18:07.494075 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Claim successful on node np0000004364 Jul 03 04:18:07.658542 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-140b89bf-6e24-440e-a1c1-aba8ca3b9946 req-11e55974-f0f4-4367-bb78-bd3cf4beabc9 service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:07.658921 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:07.659095 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port 362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:07.837372 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Took 23.14 seconds to build instance. Jul 03 04:18:08.004858 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:18:08.005486 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:18:08.005486 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:08.005636 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:08.146656 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aee4479740ae4c9091475d92afb501f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2a0313d49f4deb92b6261c9fd514cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:18:08.162578 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:08.209380 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Booting with volume 24d7b018-a8b7-4003-acf0-f8215c1668bb at /dev/vdc Jul 03 04:18:08.284991 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:08.294649 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:08.307289 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:08.334354 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:08.354363 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.665s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:08.362019 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:08.362019 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:08.368825 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:08.374014 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:08.375472 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248'] Jul 03 04:18:08.375579 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:08.375697 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:08.375916 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:08.376118 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating existing volume attachment record: 1760c733-d016-455a-a248-46214c3babbe {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:08.389793 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4505d425-85ab-43b5-8317-ea757a139230 req-950c47d4-c34e-4470-8a10-b2f1cd9ae31e service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-plugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:08.390712 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4505d425-85ab-43b5-8317-ea757a139230 req-950c47d4-c34e-4470-8a10-b2f1cd9ae31e service nova] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:08.390935 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4505d425-85ab-43b5-8317-ea757a139230 req-950c47d4-c34e-4470-8a10-b2f1cd9ae31e service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:08.391066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4505d425-85ab-43b5-8317-ea757a139230 req-950c47d4-c34e-4470-8a10-b2f1cd9ae31e service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:08.391203 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4505d425-85ab-43b5-8317-ea757a139230 req-950c47d4-c34e-4470-8a10-b2f1cd9ae31e service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] No waiting events found dispatching network-vif-plugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:08.391360 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-4505d425-85ab-43b5-8317-ea757a139230 req-950c47d4-c34e-4470-8a10-b2f1cd9ae31e service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received unexpected event network-vif-plugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c for instance with vm_state active and task_state None. Jul 03 04:18:08.505193 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:18:08.539523 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:08.753306 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Successfully created port: c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:08.867349 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: 29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:08.932808 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:08.932965 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:08.933183 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:09.016580 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:18:09.047857 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-41b9db8b-817d-4d5d-8b5e-273ba0834990 req-3b497b9f-1dbb-4603-9d81-386927072cbd service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:09.048710 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:09.050196 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port 29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:09.152646 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:09.152882 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:09.388201 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Successfully updated port: c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:09.449496 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-changed-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:09.449754 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Refreshing instance network info cache due to event network-changed-c3017691-f947-4ae3-8f82-fbfacdd74bf9. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:09.449925 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] Acquiring lock "refresh_cache-c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:09.449925 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] Acquired lock "refresh_cache-c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:09.450092 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Refreshing network info cache for port c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:09.553088 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:09.656052 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:09.705503 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:09.876412 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:09.890395 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "refresh_cache-c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:09.910755 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:09.956932 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:10.010630 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: 19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:10.036763 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:18:10.040787 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:18:10.040787 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Creating image(s) Jul 03 04:18:10.040787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "/opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:10.040787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "/opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:10.040787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "/opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:10.040787 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:10.043852 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:10.046633 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:10.065285 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:10.092553 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:10.093873 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-19674044-1b8a-481a-8591-21c98341631c. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:10.094146 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:10.124748 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:10.124980 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:10.125240 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:10.125686 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:10.130649 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:10.130899 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:10.141468 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:10.166528 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.677s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:10.167889 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:18:10.219810 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.089s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:10.220320 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:10.243097 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:10.259861 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk 1073741824" returned: 0 in 0.040s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:10.260313 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.135s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:10.260730 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:10.339101 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:10.339694 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:18:10.340030 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:10.417676 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b7dd71c4-4535-48ee-a07a-fd825b4c2c72 req-2ce29289-099d-4dd0-9b1e-9713fa2f7dd0 service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:10.418390 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:10.418652 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port 19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:10.430478 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:10.431196 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Cannot resize image /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:18:10.431196 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:18:10.431399 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Ensure instance console log exists: /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:18:10.431580 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:10.431768 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:10.431896 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:10.539509 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:18:10.541161 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:18:10.541470 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Creating image(s) Jul 03 04:18:10.542057 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:18:10.542227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Ensure instance console log exists: /opt/stack/data/nova/instances/5920b3d1-e894-469e-a7f1-add334ef4da8/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:18:10.542703 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:10.542922 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:10.543078 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:10.676793 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:18:10.677147 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:18:10.677198 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:10.677458 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:10.747493 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9eb61f07-188b-4366-a9cb-2d1fe87f100b req-b4a6f233-0ce6-4928-b0c7-2450139c5348 service nova] Releasing lock "refresh_cache-c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:10.747980 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquired lock "refresh_cache-c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:10.748121 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:10.759014 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4937ea515754406fa0fc0d376433084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f331cd7f014a0eb91a6c479ad14d3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:18:10.921183 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:11.011309 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:11.109576 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:11.177386 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: 8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:11.181086 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:18:11.205132 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:11.224800 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Successfully created port: e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:11.233740 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:11.233887 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-8533514e-4a12-45ce-9ce9-6659da1572d7. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:11.234033 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:11.318987 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:11.526792 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:11.684583 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:18:11.690062 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Updating instance_info_cache with network_info: [{"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:11.707385 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aaccebda-d0c8-4f5d-be05-f18fc96ab6f4 req-6cf071b2-e3e0-4c19-a190-ec5a9fbb5913 service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:11.707813 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:11.707993 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port 8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:11.808952 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Successfully updated port: e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:12.188838 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Booting with blank volume at /dev/vda Jul 03 04:18:12.192020 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Releasing lock "refresh_cache-c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:12.192559 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Instance network_info: |[{"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:18:12.194761 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Start _get_guest_xml network_info=[{"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:18:12.197730 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Successfully updated port: adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:12.201351 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:18:12.202541 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-235896766', uuid='c59ee2c0-5f4a-4173-a9ba-6d35fab9671d'), owner=OwnerMeta(userid='aee4479740ae4c9091475d92afb501f1', username='tempest-DeleteServersTestJSON-1622911531-project-member', projectid='da2a0313d49f4deb92b6261c9fd514cb', projectname='tempest-DeleteServersTestJSON-1622911531'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052292.202024) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:18:12.203702 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:18:12.204153 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:18:12.205838 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:18:12.205994 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:18:12.207245 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:18:12.207629 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:18:12.207823 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:18:12.207959 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:18:12.208125 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:18:12.208245 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:18:12.208394 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:18:12.208635 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:18:12.208793 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:18:12.208960 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:18:12.209115 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:18:12.209312 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:18:12.220991 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:12.231816 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-235896766',display_name='tempest-DeleteServersTestJSON-server-235896766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-deleteserverstestjson-server-235896766',id=9,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da2a0313d49f4deb92b6261c9fd514cb',ramdisk_id='',reservation_id='r-11d5ku0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1622911531',owner_user_name='tempest-DeleteServersTestJSON-1622911531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:09Z,user_data=None,user_id='aee4479740ae4c9091475d92afb501f1',uuid=c59ee2c0-5f4a-4173-a9ba-6d35fab9671d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:12.232055 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Converting VIF {"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:12.232824 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:12.236608 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lazy-loading 'pci_devices' on Instance uuid c59ee2c0-5f4a-4173-a9ba-6d35fab9671d {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:12.261296 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:12.261508 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-adede961-4ddb-4591-bc2b-9ee9955e955c. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:12.261622 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:12.312279 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:12.312418 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:12.312522 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:12.316432 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:12.529774 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:12.700230 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] End _get_guest_xml xml= Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: instance-00000009 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 196608 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: tempest-DeleteServersTestJSON-server-235896766 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 2026-07-03 04:18:12 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 192 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: True Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: bare Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: tempest-DeleteServersTestJSON-1622911531-project-member Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: tempest-DeleteServersTestJSON-1622911531 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: hvm Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 128 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: Jul 03 04:18:12.739749 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:18:12.742623 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Preparing to wait for external event network-vif-plugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:12.742623 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:12.742623 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:12.742623 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:12.742623 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-235896766',display_name='tempest-DeleteServersTestJSON-server-235896766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-deleteserverstestjson-server-235896766',id=9,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da2a0313d49f4deb92b6261c9fd514cb',ramdisk_id='',reservation_id='r-11d5ku0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1622911531',owner_user_name='tempest-DeleteServersTestJSON-1622911531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:09Z,user_data=None,user_id='aee4479740ae4c9091475d92afb501f1',uuid=c59ee2c0-5f4a-4173-a9ba-6d35fab9671d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:12.742884 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Converting VIF {"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:12.742884 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:12.742884 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:12.745585 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.745862 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:12.746100 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:12.747367 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.747422 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e27c0256-cbbd-5c3c-9c4b-7c778a2b549d', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:12.756906 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.757685 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:12.759531 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.763095 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.763095 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3017691-f9, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:12.763280 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3017691-f9, col_values=(('qos', UUID('7bdfc0ea-d306-44ac-b136-8dc0d2f2057a')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:12.763489 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3017691-f9, col_values=(('external_ids', {'iface-id': 'c3017691-f947-4ae3-8f82-fbfacdd74bf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:0e:07', 'vm-uuid': 'c59ee2c0-5f4a-4173-a9ba-6d35fab9671d'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:12.765219 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.767307 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:12.772131 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:12.774526 np0000004364 nova-compute[98951]: INFO os_vif [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') Jul 03 04:18:12.886069 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:13.031704 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c17fdcff-0b56-43f4-b540-8ada71622eac req-997c2755-6a11-4221-b4df-2d3fbdf50806 service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:13.032158 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:13.032418 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:13.070345 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:13.183120 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:13.248238 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updating instance_info_cache with network_info: [{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:13.320663 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-changed-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:13.320895 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Refreshing instance network info cache due to event network-changed-e1167715-3458-4533-88b3-e75cdc67cc48. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:13.321091 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] Acquiring lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:13.535318 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:13.616470 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:13.750804 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:13.750804 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance network_info: |[{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:18:13.751225 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] Acquired lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:13.751429 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Refreshing network info cache for port e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:13.805899 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:14.253712 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:14.290188 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:14.290339 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:14.290497 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No VIF found with MAC fa:16:3e:0a:0e:07, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:14.290859 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Using config drive Jul 03 04:18:14.311793 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-da121a08-34be-4bd4-8ed7-b6f3086f1d4d req-6fe1f603-de97-4437-a113-d79adcd49cd3 service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:14.312294 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:14.312466 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:14.560487 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:14.699167 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updated VIF entry in instance network info cache for port e1167715-3458-4533-88b3-e75cdc67cc48. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:18:14.699491 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updating instance_info_cache with network_info: [{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:14.795525 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:14.877767 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:14.888602 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:14.926009 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Creating config drive at /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk.config Jul 03 04:18:14.932234 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu7kjzyor {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:14.966010 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu7kjzyor" returned: 0 in 0.034s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:15.073013 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:15.201948 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-efa9cb19-f73f-4a2a-b47b-6ba442d5052a req-5152b470-4552-41f5-8d98-2204c17ae381 service nova] Releasing lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:15.423770 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:15.541475 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:15.564719 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:15.662728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:15.697000 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:15.710730 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:15.735079 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:15.761512 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0017416279999906692 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:15.765605 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:15.766165 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:15.766315 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] VM Stopped (Lifecycle Event) Jul 03 04:18:15.768869 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:15.769447 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:15.779840 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:15.781154 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:fe0a:e07', 'fe80::4c4c:e3ff:fe4e:d324'] Jul 03 04:18:15.781553 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:15.781651 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:15.781880 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:15.782068 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updating existing volume attachment record: 7502e94c-0523-43ec-b012-f350cc43d8f0 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:15.797521 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4b62edd6-6ad0-468e-af72-be02f0c65502 req-118c3092-cad7-4e37-ab4f-ddc8c0f48bc8 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-plugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:15.798205 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4b62edd6-6ad0-468e-af72-be02f0c65502 req-118c3092-cad7-4e37-ab4f-ddc8c0f48bc8 service nova] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:15.798482 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4b62edd6-6ad0-468e-af72-be02f0c65502 req-118c3092-cad7-4e37-ab4f-ddc8c0f48bc8 service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:15.798630 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4b62edd6-6ad0-468e-af72-be02f0c65502 req-118c3092-cad7-4e37-ab4f-ddc8c0f48bc8 service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:15.801432 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4b62edd6-6ad0-468e-af72-be02f0c65502 req-118c3092-cad7-4e37-ab4f-ddc8c0f48bc8 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Processing event network-vif-plugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:15.894278 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:15.921083 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:15.942419 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:15.943287 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:16.213919 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:16.272479 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-08d5cb31-f761-4831-8dd4-87b03f0bd14a None None] [instance: bec76c6e-db77-4b75-9c7c-31b738b93874] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:16.463162 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:16.463569 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] VM Started (Lifecycle Event) Jul 03 04:18:16.466190 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:18:16.470394 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:18:16.472207 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Instance spawned successfully. Jul 03 04:18:16.476428 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:18:16.518464 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.518839 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 03 04:18:16.520766 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager.update_available_resource {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:18:16.631789 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:16.949209 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:16.966465 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:16.968384 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:16.979836 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:16.980001 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:16.980383 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:16.980680 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:16.981010 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:16.981342 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:17.024421 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:17.029295 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:17.029295 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:17.029295 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:18:17.370827 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:17.473623 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:17.474048 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:17.474048 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] VM Paused (Lifecycle Event) Jul 03 04:18:17.486462 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Took 7.45 seconds to spawn the instance on the hypervisor. Jul 03 04:18:17.486647 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:17.594113 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [{"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:17.670564 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f4b3c59d-2b7d-4fdc-8aa8-600b879945e7 req-ccc86a58-4201-46fc-815b-aafea3292358 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:17.670805 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f4b3c59d-2b7d-4fdc-8aa8-600b879945e7 req-ccc86a58-4201-46fc-815b-aafea3292358 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:17.671891 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f4b3c59d-2b7d-4fdc-8aa8-600b879945e7 req-ccc86a58-4201-46fc-815b-aafea3292358 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:17.672115 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f4b3c59d-2b7d-4fdc-8aa8-600b879945e7 req-ccc86a58-4201-46fc-815b-aafea3292358 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:17.672302 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f4b3c59d-2b7d-4fdc-8aa8-600b879945e7 req-ccc86a58-4201-46fc-815b-aafea3292358 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:17.672709 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-f4b3c59d-2b7d-4fdc-8aa8-600b879945e7 req-ccc86a58-4201-46fc-815b-aafea3292358 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 for instance with vm_state building and task_state spawning. Jul 03 04:18:17.765882 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:17.872069 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a1cd35ed-6a8f-4e43-a575-1a30437bfc83 req-255ca4d0-8b55-4dc8-bc4e-f7c45160593c service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-plugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:17.872948 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a1cd35ed-6a8f-4e43-a575-1a30437bfc83 req-255ca4d0-8b55-4dc8-bc4e-f7c45160593c service nova] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:17.873088 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a1cd35ed-6a8f-4e43-a575-1a30437bfc83 req-255ca4d0-8b55-4dc8-bc4e-f7c45160593c service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:17.873220 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a1cd35ed-6a8f-4e43-a575-1a30437bfc83 req-255ca4d0-8b55-4dc8-bc4e-f7c45160593c service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:17.873398 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a1cd35ed-6a8f-4e43-a575-1a30437bfc83 req-255ca4d0-8b55-4dc8-bc4e-f7c45160593c service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] No waiting events found dispatching network-vif-plugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:17.873541 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-a1cd35ed-6a8f-4e43-a575-1a30437bfc83 req-255ca4d0-8b55-4dc8-bc4e-f7c45160593c service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received unexpected event network-vif-plugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 for instance with vm_state active and task_state None. Jul 03 04:18:17.938750 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:18:17.939730 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:18:17.939970 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Creating image(s) Jul 03 04:18:17.940287 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:18:17.941567 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Ensure instance console log exists: /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:18:17.942964 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:17.943151 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:17.943388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:17.943794 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Start _get_guest_xml network_info=[{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': '7502e94c-0523-43ec-b012-f350cc43d8f0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fab3fe2f-7444-4177-a9ff-0e9b068efe7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'serial': 'bcb76750-01eb-4c87-981b-f0879455c8bd'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:18:17.947991 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:18:17.949088 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1980795871', uuid='fab3fe2f-7444-4177-a9ff-0e9b068efe7c'), owner=OwnerMeta(userid='4937ea515754406fa0fc0d376433084d', username='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member', projectid='80f331cd7f014a0eb91a6c479ad14d3f', projectname='tempest-ServerBootFromVolumeStableRescueTest-1451627323'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052297.9487529) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:18:17.949798 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:18:17.950102 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:18:17.950702 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:18:17.950866 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:18:17.951697 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:18:17.951973 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:18:17.952099 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:18:17.952184 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:18:17.952379 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:18:17.952411 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:18:17.952521 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:18:17.952648 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:18:17.952752 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:18:17.952894 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:18:17.952970 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:18:17.953085 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:18:17.962075 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:17.962228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:17.963914 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connector [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Factory for ISCSI on None {{(pid=98951) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 04:18:17.964108 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:17.964218 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:17.964527 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:17.964713 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:17.965004 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:17.965691 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:17.975811 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:17.976795 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:17.977087 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:17.978344 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:17.978655 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:17.978885 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:17.979137 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:17.979515 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:17.979620 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] VM Resumed (Lifecycle Event) Jul 03 04:18:17.991764 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:17.991764 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:17.995572 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:17.995572 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:17.998728 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Took 14.14 seconds to build instance. Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd] added Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:18.007267 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:18.007698 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:18.007698 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:18.007835 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd] added Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:18.009427 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:18.009606 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:18.009771 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:18.009940 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:18.063936 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.098414 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:18.100858 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance network_info: |[{"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:18:18.104228 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Start _get_guest_xml network_info=[{"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dad20ac7-d9ca-406d-8d8f-ef9fb6f3e18e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5920b3d1-e894-469e-a7f1-add334ef4da8', 'attached_at': '', 'detached_at': '', 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'serial': '7dac5ac5-7275-4620-ba08-d3ff61711cf9'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'attachment_id': '77a01be7-ebac-41eb-bc9a-b4768ab42b78', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5920b3d1-e894-469e-a7f1-add334ef4da8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'serial': 'f3124766-0a3c-47a2-843c-c0bee03dfe51'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'attachment_id': '1760c733-d016-455a-a248-46214c3babbe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5920b3d1-e894-469e-a7f1-add334ef4da8', 'attached_at': '', 'detached_at': '', 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'serial': '24d7b018-a8b7-4003-acf0-f8215c1668bb'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:18:18.115080 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:18:18.115903 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1249100034', uuid='5920b3d1-e894-469e-a7f1-add334ef4da8'), owner=OwnerMeta(userid='18ba934fdb74408791fccc735ddf0237', username='tempest-TaggedBootDevicesTest_v242-1654626809-project-member', projectid='8018e37ae1254f68bfa475fb7625949c', projectname='tempest-TaggedBootDevicesTest_v242-1654626809'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052298.1146994) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:18:18.117048 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:18:18.117723 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:18:18.119466 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:18:18.119766 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:18:18.121143 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:18:18.121542 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:18:18.121753 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:18:18.121891 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:18:18.122026 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:18:18.122132 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:18:18.122176 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:18:18.124786 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:18:18.124786 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:18:18.124786 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:18:18.124786 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:18:18.124786 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:18:18.142703 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.143923 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.144427 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:18.144866 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:18.145040 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:18.248595 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.251887 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.339740 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.340342 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.418554 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.421390 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.484034 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:18.485537 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:18.488493 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.488956 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.501708 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.653s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:18.555134 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.557613 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.623046 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.623566 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.688161 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.690580 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.780430 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.781009 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.858872 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.861774 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:18.939636 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:18.940124 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:19.008557 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:19.009354 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:19.010461 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:19.015017 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:19.025937 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:19.029193 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:19.038694 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:19.043687 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:19.048442 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 04:18:19.048442 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:19.048628 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 04:18:19.048628 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:19.049232 np0000004364 nova-compute[98951]: WARNING os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 04:18:19.049232 np0000004364 nova-compute[98951]: Jul 03 04:18:19.053930 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 04:18:19.053930 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:19.054140 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 04:18:19.054140 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:19.054196 np0000004364 nova-compute[98951]: WARNING os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 04:18:19.054196 np0000004364 nova-compute[98951]: Jul 03 04:18:19.095774 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:19.096177 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:19.180059 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:19.183819 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:18:19.185003 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:19.214306 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "env LANG=C uptime" returned: 0 in 0.029s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:19.214771 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Hypervisor/Node resource view: name=np0000004364 free_ram=51316MB free_disk=74.60383987426758GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:18:19.214984 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.215282 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.324481 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.324697 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.741729 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.742484 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.742706 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.742859 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.743033 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No event matching network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 in dict_keys([('network-vif-plugged', '0d57f313-fcff-42ac-a3c3-e0139470d053')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:19.743174 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received unexpected event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with vm_state building and task_state spawning. Jul 03 04:18:19.743446 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.743597 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.743682 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.743746 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.743877 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Processing event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:19.744013 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.744136 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.744260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.744398 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.744536 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:19.744647 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received unexpected event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with vm_state building and task_state spawning. Jul 03 04:18:19.744988 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.745657 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Instance event wait completed in 16 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:18:19.745915 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.745915 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.746020 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.746128 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:19.746221 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba for instance with vm_state building and task_state spawning. Jul 03 04:18:19.746315 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.746506 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 for instance with vm_state building and task_state spawning. Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.747233 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.747517 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.747517 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:19.747517 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c for instance with vm_state building and task_state spawning. Jul 03 04:18:19.747623 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:19.747718 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:19.747924 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:19.748015 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:19.748106 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:19.748200 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-566ae980-8297-4f9a-8bf7-1bb4ba52d104 req-e8d1840c-49ef-4d19-96db-c411389317db service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state building and task_state spawning. Jul 03 04:18:19.748728 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:19.748906 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] VM Resumed (Lifecycle Event) Jul 03 04:18:19.750182 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:18:19.752922 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Instance spawned successfully. Jul 03 04:18:19.753474 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:18:19.828863 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lazy-loading 'flavor' on Instance uuid c59ee2c0-5f4a-4173-a9ba-6d35fab9671d {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:19.891510 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:20.085158 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.50.100,3260] Jul 03 04:18:20.085158 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.50.100,3260] successful. Jul 03 04:18:20.085158 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:20.087545 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.40.100,3260] Jul 03 04:18:20.087545 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.40.100,3260] successful. Jul 03 04:18:20.087545 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:20.099901 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:20.108005 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:20.113246 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.113246 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.113246 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:20.113246 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.113246 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.113246 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:20.113729 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.135s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:20.114084 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:20.115975 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:20.116304 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:20.124007 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.124007 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.124007 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:20.124155 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.124155 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:20.124155 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:20.124460 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.146s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:20.124569 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:20.124982 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:20.125053 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:20.125759 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:20.140084 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:20.140084 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:20.147840 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:20.148057 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:20.253271 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:20.254571 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:20.259958 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:20.260098 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:20.260806 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:20.260806 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:20.261105 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:20.261420 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:20.304696 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b5ee81e7-eef9-4b72-a375-30801621eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.304887 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 985dc90b-e484-4add-b0d7-c37a5f952ce6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305063 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 29fd1525-8166-4498-b726-4199f68e7deb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305267 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 944f22bd-e9ac-4a28-8278-623847d01847 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305267 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305515 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance e60c0794-599a-4409-8806-ee2697a55a78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305578 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 5920b3d1-e894-469e-a7f1-add334ef4da8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305674 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c59ee2c0-5f4a-4173-a9ba-6d35fab9671d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.305791 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance fab3fe2f-7444-4177-a9ff-0e9b068efe7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:18:20.306051 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:18:20.306299 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:18:19 up 26 min, 2 users, load average: 7.40, 3.18, 1.50\n', 'num_instances': '9', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_80f331cd7f014a0eb91a6c479ad14d3f': '2', 'io_workload': '3', 'num_proj_a71449bab216465bb9a55183718ff364': '1', 'num_proj_879afb1507f042ebbf29d91b8c5289c9': '1', 'num_proj_58bbf86bcaa34d1fa4054c0afb4ac404': '1', 'num_proj_1f1828cb9b324d3daf261da0474ab91f': '2', 'num_vm_building': '3', 'num_task_spawning': '3', 'num_proj_8018e37ae1254f68bfa475fb7625949c': '1', 'num_proj_da2a0313d49f4deb92b6261c9fd514cb': '1'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:18:20.758819 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: e60c0794-599a-4409-8806-ee2697a55a78] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:20.767819 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Took 24.77 seconds to spawn the instance on the hypervisor. Jul 03 04:18:20.768085 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:20.834153 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:20.874058 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:20.874058 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:20.978649 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:21.278760 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Took 36.55 seconds to build instance. Jul 03 04:18:21.379230 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:21.780466 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-567ca557-d712-41b1-aa68-800f0e9fd1ae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 38.059s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:21.890056 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:18:21.890304 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.675s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:21.890905 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 57.69 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:18:22.004847 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Found WWN 33000000040a09d61 for multipath device dm-0 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:22.005337 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.040s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:22.005510 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '33000000040a09d61', 'path': '/dev/dm-0', 'multipath_id': '33000000040a09d61'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:22.005725 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000040a09d61', 'path': '/dev/dm-0', 'multipath_id': '33000000040a09d61'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:22.007881 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.863s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:22.010864 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:22.022598 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:22.028811 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:22.029618 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:22.030225 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:22.030444 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:22.030666 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:22.043777 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:22.043777 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:22.049664 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:22.049664 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9] added Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:22.057935 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:22.058424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:22.058534 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:22.058731 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9] added Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:22.061247 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:22.061557 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:22.061730 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:22.061937 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:22.400110 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:22.400375 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:22.400616 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Attaching volume 7563c98d-e9a5-461f-86a0-da776387d247 to /dev/vdb Jul 03 04:18:22.454694 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:22.467895 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:22.495576 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:22.519435 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1980795871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1980795871',id=10,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-s0ffab9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:12Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=fab3fe2f-7444-4177-a9ff-0e9b068efe7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:22.519698 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:22.520519 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:22.521889 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:22.523474 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'pci_devices' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:22.525303 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:22.534887 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:22.536881 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:fe0a:e07', 'fe80::4c4c:e3ff:fe4e:d324'] Jul 03 04:18:22.537069 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:22.537141 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:22.537784 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:22.538111 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Updating existing volume attachment record: afac3cb7-26c5-4ce0-948d-8a11a092287d {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:22.694618 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-changed-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:22.694618 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Refreshing instance network info cache due to event network-changed-0d57f313-fcff-42ac-a3c3-e0139470d053. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:22.694618 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] Acquiring lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:22.694850 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] Acquired lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:22.694922 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Refreshing network info cache for port 0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:22.748968 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:22.766830 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] End _get_guest_xml xml= Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: instance-0000000a Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 196608 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-server-1980795871 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 2026-07-03 04:18:17 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 192 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: True Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: bare Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: hvm Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 128 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: bcb76750-01eb-4c87-981b-f0879455c8bd Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Preparing to wait for external event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1980795871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1980795871',id=10,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-s0ffab9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:12Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=fab3fe2f-7444-4177-a9ff-0e9b068efe7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:23.030574 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:23.033389 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:23.033389 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:23.033389 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:23.034406 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:23.034630 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e35b6fea-8567-5422-bced-fcbf3e2ab807', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:23.043575 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:23.045567 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:23.045751 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1167715-34, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:23.046108 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1167715-34, col_values=(('qos', UUID('845f1ac6-5c5c-43ce-b612-875c09b19c29')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:23.046341 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1167715-34, col_values=(('external_ids', {'iface-id': 'e1167715-3458-4533-88b3-e75cdc67cc48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:c0:dc', 'vm-uuid': 'fab3fe2f-7444-4177-a9ff-0e9b068efe7c'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:23.049055 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:23.053224 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:23.055016 np0000004364 nova-compute[98951]: INFO os_vif [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') Jul 03 04:18:23.059182 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:23.062497 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:23.073829 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:23.078821 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.090903 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.097050 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.108929 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:23.109348 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7563c98d-e9a5-461f-86a0-da776387d247', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:23.109564 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:23.111093 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.111093 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.111093 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:23.111093 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.111093 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.111093 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:23.112106 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.112106 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.112106 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:23.112256 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.112256 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.112256 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:23.145918 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.50.100,3260] Jul 03 04:18:23.145918 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.50.100,3260] successful. Jul 03 04:18:23.145918 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.155443 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.40.100,3260] Jul 03 04:18:23.155443 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.40.100,3260] successful. Jul 03 04:18:23.155443 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.165459 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.170610 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:23.185433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:23.186633 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.186633 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.186633 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.186633 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.186633 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:23.186790 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.186790 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:23.186790 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.186790 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:23.186790 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:23.187389 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:23.187389 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:23.188099 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:23.188185 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:23.199080 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:23.231813 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:23.232027 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:23.239143 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:23.239412 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:23.685418 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:23.841217 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updated VIF entry in instance network info cache for port 0d57f313-fcff-42ac-a3c3-e0139470d053. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:18:23.841543 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updating instance_info_cache with network_info: [{"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:24.032706 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:24.343584 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ea2d2cf7-f254-45da-a3b7-a473f978dc06 req-143a98a2-0485-46de-a2ee-43b8c3578a46 service nova] Releasing lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:24.578109 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:24.578109 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:24.578109 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No VIF found with MAC fa:16:3e:e7:c0:dc, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:24.578493 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Using config drive Jul 03 04:18:24.894911 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:25.050276 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Found WWN 3300000007e971642 for multipath device dm-1 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:25.050717 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:25.050842 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== connect_volume: return (6906ms) {'type': 'block', 'scsi_wwn': '3300000007e971642', 'path': '/dev/dm-1', 'multipath_id': '3300000007e971642'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:25.050986 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007e971642', 'path': '/dev/dm-1', 'multipath_id': '3300000007e971642'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:25.051686 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.942s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:25.052036 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7563c98d-e9a5-461f-86a0-da776387d247', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:25.062943 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:25.063499 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:25.064047 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:25.064254 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:25.064695 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:25.064955 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:25.074940 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:25.074940 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:25.079976 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:25.079976 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:25.084707 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247] added Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:25.092555 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:25.093055 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:25.093055 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:25.093210 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247] added Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:25.095949 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:25.229982 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Creating config drive at /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config Jul 03 04:18:25.234551 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7r3pxmfd {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:25.276891 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7r3pxmfd" returned: 0 in 0.042s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:25.558455 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:25.560033 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:25.560033 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:25.750679 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:25.778199 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:25.781106 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:25.887476 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:25.937847 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:25.938946 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:26.008404 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6c9af590-5991-41ad-abef-16a5be6002b2 req-37aaff04-a2d6-419c-90f2-4a09d08157bf service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:26.008688 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6c9af590-5991-41ad-abef-16a5be6002b2 req-37aaff04-a2d6-419c-90f2-4a09d08157bf service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:26.008896 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6c9af590-5991-41ad-abef-16a5be6002b2 req-37aaff04-a2d6-419c-90f2-4a09d08157bf service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:26.009083 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6c9af590-5991-41ad-abef-16a5be6002b2 req-37aaff04-a2d6-419c-90f2-4a09d08157bf service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:26.009239 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6c9af590-5991-41ad-abef-16a5be6002b2 req-37aaff04-a2d6-419c-90f2-4a09d08157bf service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Processing event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:26.093714 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:26.096485 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:26.109472 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:26.118042 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.124611 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.133879 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.145612 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.145612 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.145612 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.145612 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.145612 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:26.145842 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.145842 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.145842 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.145842 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.145842 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:26.154944 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.154944 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.154944 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.154944 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.154944 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:26.155175 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.155175 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.155175 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.155175 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.155175 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:26.196939 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.40.100,3260] Jul 03 04:18:26.196939 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.40.100,3260] successful. Jul 03 04:18:26.196939 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.202314 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.50.100,3260] Jul 03 04:18:26.202314 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.50.100,3260] successful. Jul 03 04:18:26.202314 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.210082 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.218242 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.227688 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.227932 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:26.228231 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:26.228408 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:26.229319 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:26.229475 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.237446 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:26.237763 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:26.238006 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:26.238212 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:26.239152 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:26.239334 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:26.248927 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:26.249115 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7563c98d-e9a5-461f-86a0-da776387d247', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:26.258239 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:26.258678 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7563c98d-e9a5-461f-86a0-da776387d247', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:26.722141 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:26.722290 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Started (Lifecycle Event) Jul 03 04:18:26.724057 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:18:26.727463 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:18:26.729484 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance spawned successfully. Jul 03 04:18:26.729945 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:18:26.860661 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:27.065637 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:27.226090 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:27.228371 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:27.235204 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:27.235362 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:27.235689 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:27.235925 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:27.236185 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:27.236690 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:27.730100 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:27.730789 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:27.730789 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Paused (Lifecycle Event) Jul 03 04:18:27.741994 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Took 9.80 seconds to spawn the instance on the hypervisor. Jul 03 04:18:27.742238 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:28.047913 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:28.082955 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Found WWN 330000000e2b1f82b for multipath device dm-4 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:28.083354 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:28.086783 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.525s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:28.087249 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] <== connect_volume: return (4976ms) {'type': 'block', 'scsi_wwn': '330000000e2b1f82b', 'path': '/dev/dm-4', 'multipath_id': '330000000e2b1f82b'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:28.087526 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:28.088562 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e2b1f82b', 'path': '/dev/dm-4', 'multipath_id': '330000000e2b1f82b'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:28.095354 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lazy-loading 'flavor' on Instance uuid c59ee2c0-5f4a-4173-a9ba-6d35fab9671d {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:28.097441 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-473319ca-ebaa-4149-9384-85b6e9a31a29 req-d70a076e-f7e3-468b-80d0-e947841bd3b5 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:28.097692 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-473319ca-ebaa-4149-9384-85b6e9a31a29 req-d70a076e-f7e3-468b-80d0-e947841bd3b5 service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:28.098035 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-473319ca-ebaa-4149-9384-85b6e9a31a29 req-d70a076e-f7e3-468b-80d0-e947841bd3b5 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:28.098134 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-473319ca-ebaa-4149-9384-85b6e9a31a29 req-d70a076e-f7e3-468b-80d0-e947841bd3b5 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:28.099950 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-473319ca-ebaa-4149-9384-85b6e9a31a29 req-d70a076e-f7e3-468b-80d0-e947841bd3b5 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:28.100283 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-473319ca-ebaa-4149-9384-85b6e9a31a29 req-d70a076e-f7e3-468b-80d0-e947841bd3b5 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state None. Jul 03 04:18:28.103479 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:28.104143 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:28.104636 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:28.104938 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:28.105371 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:28.105549 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:28.118785 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:28.118785 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:28.119988 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:28.119988 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51] added Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:28.132974 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:28.133237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:28.133592 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:28.133849 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51] added Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:28.137419 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:28.137621 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:28.137728 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:28.137928 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:28.237687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:28.241451 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:28.241451 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Resumed (Lifecycle Event) Jul 03 04:18:28.263894 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Took 22.67 seconds to build instance. Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Attempting to attach volume 7563c98d-e9a5-461f-86a0-da776387d247 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] attach device xml: Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: 7563c98d-e9a5-461f-86a0-da776387d247 Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: Jul 03 04:18:28.599165 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:18:28.632931 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:28.741632 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:28.744257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:28.765671 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-26910cf4-fe08-4df5-8849-4b0633e2a374 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.181s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:29.134659 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:29.138303 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:29.147711 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:29.158078 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.164523 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.171506 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.183923 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.184100 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.189200 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.189463 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:29.234970 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.40.100,3260] Jul 03 04:18:29.234970 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.40.100,3260] successful. Jul 03 04:18:29.234970 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.250868 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.50.100,3260] Jul 03 04:18:29.250868 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.50.100,3260] successful. Jul 03 04:18:29.250868 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.252582 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.265207 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.279717 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.280170 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:29.280440 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:29.280440 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:29.281477 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:29.281607 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:29.297011 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:29.297383 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:29.301029 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:29.301767 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:29.302085 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:29.303979 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:29.304367 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:29.327744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:29.327744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:29.905343 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:30.106019 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:30.276639 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:30.277021 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:30.277021 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:30.277021 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] No VIF found with MAC fa:16:3e:0a:0e:07, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:30.295142 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Rescuing Jul 03 04:18:30.295390 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:30.295545 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:30.295703 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:30.798718 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:31.130799 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Found WWN 330000000df9d3654 for multipath device dm-5 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:31.131186 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:31.131437 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== connect_volume: return (5571ms) {'type': 'block', 'scsi_wwn': '330000000df9d3654', 'path': '/dev/dm-5', 'multipath_id': '330000000df9d3654'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:31.131655 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000df9d3654', 'path': '/dev/dm-5', 'multipath_id': '330000000df9d3654'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:31.134610 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:31.299723 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:31.299723 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:31.344921 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updating instance_info_cache with network_info: [{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:31.641034 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:31.641266 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:31.641407 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:31.641690 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:31.641863 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:31.653452 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:31.654009 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:31.654489 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:31.654637 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:31.655199 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:31.655606 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:31.665275 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:31.665275 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:31.671199 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:31.671199 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb] added Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:31.678295 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:31.678640 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:31.678640 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:31.678728 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb] added Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:31.681944 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:31.682223 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:31.682345 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:31.682539 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:31.803464 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'flavor' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:31.847000 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:31.860552 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3f357fe0-4d74-4a2c-9743-e5e3aae9e2cb tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.460s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:32.561096 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:32.561578 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:32.561578 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:32.561578 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:32.561709 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:32.563847 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Terminating instance Jul 03 04:18:32.679190 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:32.683098 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:32.693309 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:32.696705 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.712321 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.713139 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.732443 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.732762 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.733364 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.733609 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:32.784069 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.40.100,3260] Jul 03 04:18:32.784069 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.40.100,3260] successful. Jul 03 04:18:32.784069 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.794079 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.50.100,3260] Jul 03 04:18:32.794079 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.50.100,3260] successful. Jul 03 04:18:32.794079 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.795965 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.807019 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:32.808886 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.816629 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:32.817009 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:32.817301 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:32.818505 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:32.818620 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.825629 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:32.825930 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:32.826132 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:32.826252 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:32.827550 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:32.827673 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:32.836677 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:32.836677 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:32.843860 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:32.843860 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:33.055782 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.067535 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:18:33.088188 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.109541 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.118635 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.139142 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.140233 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.241191 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a39cee38-1f46-4db9-a826-29de8a861049 req-d598e76a-5bab-4140-a72f-80f45149af05 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-unplugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:33.241353 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a39cee38-1f46-4db9-a826-29de8a861049 req-d598e76a-5bab-4140-a72f-80f45149af05 service nova] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:33.241840 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a39cee38-1f46-4db9-a826-29de8a861049 req-d598e76a-5bab-4140-a72f-80f45149af05 service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:33.241840 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a39cee38-1f46-4db9-a826-29de8a861049 req-d598e76a-5bab-4140-a72f-80f45149af05 service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:33.241965 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a39cee38-1f46-4db9-a826-29de8a861049 req-d598e76a-5bab-4140-a72f-80f45149af05 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] No waiting events found dispatching network-vif-unplugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:33.242012 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a39cee38-1f46-4db9-a826-29de8a861049 req-d598e76a-5bab-4140-a72f-80f45149af05 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-unplugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:33.408862 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999711599999955 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:33.409144 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99940367299996 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:33.409309 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999226258000135 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:33.410863 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Instance destroyed successfully. Jul 03 04:18:33.412156 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lazy-loading 'resources' on Instance uuid c59ee2c0-5f4a-4173-a9ba-6d35fab9671d {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:33.496469 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.499756 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.522862 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.655075 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:33.676506 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.688567 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.789798 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.802839 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999741905999826 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:33.804856 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance destroyed successfully. Jul 03 04:18:33.805240 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.806609 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'numa_topology' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:33.862955 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8eda374b-a926-4373-92ce-4a4b98d69a3c req-040ffa5c-0c9d-428d-ba87-7aa97fd0975f service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:33.863386 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8eda374b-a926-4373-92ce-4a4b98d69a3c req-040ffa5c-0c9d-428d-ba87-7aa97fd0975f service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:33.864186 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8eda374b-a926-4373-92ce-4a4b98d69a3c req-040ffa5c-0c9d-428d-ba87-7aa97fd0975f service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:33.864186 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8eda374b-a926-4373-92ce-4a4b98d69a3c req-040ffa5c-0c9d-428d-ba87-7aa97fd0975f service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:33.864186 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8eda374b-a926-4373-92ce-4a4b98d69a3c req-040ffa5c-0c9d-428d-ba87-7aa97fd0975f service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:33.864186 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8eda374b-a926-4373-92ce-4a4b98d69a3c req-040ffa5c-0c9d-428d-ba87-7aa97fd0975f service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state rescuing. Jul 03 04:18:33.913836 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-235896766',display_name='tempest-DeleteServersTestJSON-server-235896766',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-deleteserverstestjson-server-235896766',id=9,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:18:17Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='da2a0313d49f4deb92b6261c9fd514cb',ramdisk_id='',reservation_id='r-11d5ku0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1622911531',owner_user_name='tempest-DeleteServersTestJSON-1622911531-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:18Z,user_data=None,user_id='aee4479740ae4c9091475d92afb501f1',uuid=c59ee2c0-5f4a-4173-a9ba-6d35fab9671d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:18:33.916347 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Converting VIF {"id": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "address": "fa:16:3e:0a:0e:07", "network": {"id": "ba43ba5a-ee4c-4fab-ab26-a70651b60949", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-971457753-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da2a0313d49f4deb92b6261c9fd514cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3017691-f9", "ovs_interfaceid": "c3017691-f947-4ae3-8f82-fbfacdd74bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:33.916347 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:33.916347 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:18:33.917429 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.917714 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3017691-f9, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:33.918795 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.921016 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:33.925816 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.927044 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.927291 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bdfc0ea-d306-44ac-b136-8dc0d2f2057a) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:33.928849 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.930141 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:33.937505 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:33.939884 np0000004364 nova-compute[98951]: INFO os_vif [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:0e:07,bridge_name='br-int',has_traffic_filtering=True,id=c3017691-f947-4ae3-8f82-fbfacdd74bf9,network=Network(ba43ba5a-ee4c-4fab-ab26-a70651b60949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3017691-f9') Jul 03 04:18:33.941942 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:18:33.941942 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7563c98d-e9a5-461f-86a0-da776387d247', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:33.941942 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:34.314518 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Attempting a stable device rescue Jul 03 04:18:34.383728 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:34.383867 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:34.383989 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Attaching volume 5eb4de56-65f0-42be-9fa8-65917cfadb53 to /dev/vdb Jul 03 04:18:34.409305 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 03 04:18:34.416402 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance directory exists: not creating {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 03 04:18:34.416561 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Creating image(s) Jul 03 04:18:34.417247 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "/opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:34.417472 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:34.418002 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:34.418224 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'trusted_certs' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:34.438512 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:34.449465 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:34.470610 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:34.493601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:34.493963 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:34.503370 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:34.504737 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248'] Jul 03 04:18:34.504950 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:34.504950 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:34.505140 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== get_connector_properties: return (66ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:34.505382 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating existing volume attachment record: 62022350-0302-4c72-b11e-6c1784a7a5b3 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:34.674746 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Found WWN 330000000c0286364 for multipath device dm-6 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:34.675301 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:34.675467 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000c0286364', 'path': '/dev/dm-6', 'multipath_id': '330000000c0286364'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:34.675652 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c0286364', 'path': '/dev/dm-6', 'multipath_id': '330000000c0286364'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:34.676287 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.734s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:34.677349 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7563c98d-e9a5-461f-86a0-da776387d247', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:18:34.677349 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', '7')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247', '8')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:34.710382 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Resulting device map defaultdict(. at 0x76c4505711c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'): ({'sdg'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:18:34.711177 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Removing multipathed devices sdf, sdg {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:18:34.711515 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Flush multipath device 330000000e2b1f82b {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:18:34.745837 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:34.800490 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:34.868698 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:18:34.868698 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:18:34.868698 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:18:34.884299 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:18:34.884299 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:18:34.896676 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:34.906636 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:34.920366 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:34.920730 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "a8c05472b9279949f9e9859963f0b368ad865070" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:34.921124 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "a8c05472b9279949f9e9859963f0b368ad865070" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:34.939869 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.40.100,3260] Jul 03 04:18:34.939869 np0000004364 nova-compute[98951]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.40.100,3260] successful. Jul 03 04:18:34.939869 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:34.963768 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:34.979202 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.020970 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.50.100,3260] Jul 03 04:18:35.020970 np0000004364 nova-compute[98951]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-7563c98d-e9a5-461f-86a0-da776387d247, portal: 192.168.50.100,3260] successful. Jul 03 04:18:35.020970 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.040603 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.040603 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:35.040603 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] <== disconnect_volume: return (1097ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:35.040603 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:18:35.040603 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Deleting instance files /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d_del Jul 03 04:18:35.040603 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Deletion of /opt/stack/data/nova/instances/c59ee2c0-5f4a-4173-a9ba-6d35fab9671d_del complete Jul 03 04:18:35.077345 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:35.077688 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:35.077843 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:35.078276 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:35.078554 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:35.090664 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:35.091164 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:35.091343 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:35.092162 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:35.096514 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:35.097061 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:35.105023 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:35.105023 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.113290 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:35.113290 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53] added Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:35.119320 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.119572 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:35.119802 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:35.120282 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53] added Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:35.125302 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:35.125599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:35.125599 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:35.125761 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:35.186725 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.186872 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.187464 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.188152 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.188305 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.188685 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.189220 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.189369 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.189648 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.190128 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.190235 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.190620 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.191146 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.191263 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.191577 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.192070 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.192204 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.192499 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.192958 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:35.193081 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.193441 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.194003 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lazy-loading 'pci_devices' on Instance uuid 5920b3d1-e894-469e-a7f1-add334ef4da8 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:35.343335 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a5c53ddc-99cc-4230-9f4b-e8d72d89472e req-e939957f-d77a-4e19-9cff-26e68cda3d92 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-unplugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:35.345086 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a5c53ddc-99cc-4230-9f4b-e8d72d89472e req-e939957f-d77a-4e19-9cff-26e68cda3d92 service nova] Acquiring lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.345301 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a5c53ddc-99cc-4230-9f4b-e8d72d89472e req-e939957f-d77a-4e19-9cff-26e68cda3d92 service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.345464 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a5c53ddc-99cc-4230-9f4b-e8d72d89472e req-e939957f-d77a-4e19-9cff-26e68cda3d92 service nova] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.345594 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a5c53ddc-99cc-4230-9f4b-e8d72d89472e req-e939957f-d77a-4e19-9cff-26e68cda3d92 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] No waiting events found dispatching network-vif-unplugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:35.345814 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a5c53ddc-99cc-4230-9f4b-e8d72d89472e req-e939957f-d77a-4e19-9cff-26e68cda3d92 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-unplugged-c3017691-f947-4ae3-8f82-fbfacdd74bf9 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:35.546137 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Took 2.48 seconds to destroy the instance on the hypervisor. Jul 03 04:18:35.546796 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:18:35.547431 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:18:35.547431 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:18:35.547658 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:35.660593 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] End _get_guest_xml xml= Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 5920b3d1-e894-469e-a7f1-add334ef4da8 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: instance-00000008 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 196608 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: tempest-device-tagging-server-1249100034 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 2026-07-03 04:18:18 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 192 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: True Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: bare Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: tempest-TaggedBootDevicesTest_v242-1654626809-project-member Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: tempest-TaggedBootDevicesTest_v242-1654626809 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 5920b3d1-e894-469e-a7f1-add334ef4da8 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 5920b3d1-e894-469e-a7f1-add334ef4da8 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: hvm Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 128 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 7dac5ac5-7275-4620-ba08-d3ff61711cf9 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: f3124766-0a3c-47a2-843c-c0bee03dfe51 Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: 24d7b018-a8b7-4003-acf0-f8215c1668bb Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: Jul 03 04:18:35.697477 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.701274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.702022 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.702022 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.702022 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.702022 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Preparing to wait for external event network-vif-plugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:18:35.702165 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.702466 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.703105 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.703582 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:35.703783 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.704436 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.704711 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:35.705164 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.705505 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.705776 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:35.707820 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.708062 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cc1123c-3475-5e9b-ac19-35702d55999b', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.719344 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.719754 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.725016 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.727574 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.727772 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe950017-4b, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.728100 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe950017-4b, col_values=(('qos', UUID('535f2832-a503-4424-90b5-03272076ce3f')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.728274 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe950017-4b, col_values=(('external_ids', {'iface-id': 'fe950017-4bf0-4122-ac89-ebd512e7c5ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:96:94', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.729104 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.730354 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.739244 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.740032 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') Jul 03 04:18:35.740757 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:35.740944 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.741785 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.742034 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:35.742284 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.742513 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.742729 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:35.743533 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.743675 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a140e26-9b3b-58fc-a1ed-43381a17b062', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.744397 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.745187 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.754677 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:35.757545 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:35.758097 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.759241 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.part --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:35.768205 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.769049 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap990dad4f-21, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.770211 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap990dad4f-21, col_values=(('qos', UUID('eacb0604-3a1f-457a-9c8f-fb784a5de5c1')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.770486 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap990dad4f-21, col_values=(('external_ids', {'iface-id': '990dad4f-21fa-472f-bf2e-4d119a9720ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:27:02', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.771755 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.773127 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.795592 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.795592 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') Jul 03 04:18:35.795592 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:35.795592 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.798482 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfeba7b0-b8fd-58cc-acd3-a27a92c83422', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.803550 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.803550 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.823019 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.826385 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.826516 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap362342a9-83, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.826886 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap362342a9-83, col_values=(('qos', UUID('389e4d0d-e0d1-4685-ad7a-883b7cc122fd')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.827054 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap362342a9-83, col_values=(('external_ids', {'iface-id': '362342a9-83a3-4b70-a87b-9f6857c94d27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:04:42', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.827904 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.830627 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.839913 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.part --force-share --output=json" returned: 0 in 0.081s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:35.840318 np0000004364 nova-compute[98951]: DEBUG nova.virt.images [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ae06652b-203f-4a25-bafb-13418af32f29 was qcow2, converting to raw {{(pid=98951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 03 04:18:35.841009 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:18:35.841319 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.part /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.converted {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:35.851346 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.852684 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') Jul 03 04:18:35.854100 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:35.854288 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.855195 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.855470 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:35.856580 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.856580 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.856580 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:35.857639 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.857874 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cf40715-824d-5509-be9f-bdb72e9b155c', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.858737 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.859644 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.881317 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.883912 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.885340 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29c965bb-06, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.885340 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29c965bb-06, col_values=(('qos', UUID('230ed580-3902-4f8c-a360-dfb2261c5fcf')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.885340 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29c965bb-06, col_values=(('external_ids', {'iface-id': '29c965bb-06bd-4c50-a7d8-04a4aca7b4a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:1f:c2', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.887155 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.888643 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.914545 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.914934 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') Jul 03 04:18:35.916124 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:35.916312 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.916858 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.917431 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.part /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.converted" returned: 0 in 0.076s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:35.917647 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:35.918257 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.918610 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.918884 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:35.919708 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.919932 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8e56ada-aa5e-5b8b-8f14-3e78e9956556', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.920686 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.921414 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.923309 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.converted --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:35.948641 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.952957 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b2101832-3abc-4002-aed5-ecafea75ed76 req-ae76f4d7-e6e9-4719-855c-9d6eed3565d9 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:35.954999 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b2101832-3abc-4002-aed5-ecafea75ed76 req-ae76f4d7-e6e9-4719-855c-9d6eed3565d9 service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:35.954999 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b2101832-3abc-4002-aed5-ecafea75ed76 req-ae76f4d7-e6e9-4719-855c-9d6eed3565d9 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:35.955447 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b2101832-3abc-4002-aed5-ecafea75ed76 req-ae76f4d7-e6e9-4719-855c-9d6eed3565d9 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:35.955447 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b2101832-3abc-4002-aed5-ecafea75ed76 req-ae76f4d7-e6e9-4719-855c-9d6eed3565d9 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:35.955667 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-b2101832-3abc-4002-aed5-ecafea75ed76 req-ae76f4d7-e6e9-4719-855c-9d6eed3565d9 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state rescuing. Jul 03 04:18:35.957295 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.957760 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19674044-1b, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.958252 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19674044-1b, col_values=(('qos', UUID('0ace25ee-e1ed-404f-b12c-3f5e96157f85')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.958549 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19674044-1b, col_values=(('external_ids', {'iface-id': '19674044-1b8a-481a-8591-21c98341631c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:1d:0c', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.964845 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:35.992568 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.993274 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') Jul 03 04:18:35.994319 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:35.994560 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:35.995287 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:35.995668 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:35.996261 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.996573 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.996835 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:35.997945 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:35.998178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd901bd9-71bf-5d35-88dd-cf0c7d9fadfa', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:35.999672 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.000629 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:36.003955 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070.converted --force-share --output=json" returned: 0 in 0.081s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:36.004937 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "a8c05472b9279949f9e9859963f0b368ad865070" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.084s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:36.005846 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:36.011050 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:36.013985 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "a8c05472b9279949f9e9859963f0b368ad865070" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:36.014576 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "a8c05472b9279949f9e9859963f0b368ad865070" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:36.014967 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:36.021790 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:18:36.026022 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:36.041954 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.055447 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a3ba271f-2cd6-401d-bf3f-6a0d0c2ab513 req-fcdf8d7b-9705-47f8-a025-dec1b5f0c6e3 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Received event network-vif-deleted-c3017691-f947-4ae3-8f82-fbfacdd74bf9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:36.056128 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-a3ba271f-2cd6-401d-bf3f-6a0d0c2ab513 req-fcdf8d7b-9705-47f8-a025-dec1b5f0c6e3 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Neutron deleted interface c3017691-f947-4ae3-8f82-fbfacdd74bf9; detaching it from the instance and deleting it from the info cache Jul 03 04:18:36.058375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.058375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8533514e-4a, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.058375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8533514e-4a, col_values=(('qos', UUID('7d8d7a07-b709-4b02-bd31-0518075aa0dc')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.058375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8533514e-4a, col_values=(('external_ids', {'iface-id': '8533514e-4a12-45ce-9ce9-6659da1572d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:18:ad', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.061440 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:36.063857 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a3ba271f-2cd6-401d-bf3f-6a0d0c2ab513 req-fcdf8d7b-9705-47f8-a025-dec1b5f0c6e3 service nova] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Detach interface failed, port_id=c3017691-f947-4ae3-8f82-fbfacdd74bf9, reason: Instance c59ee2c0-5f4a-4173-a9ba-6d35fab9671d could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:18:36.096268 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.099650 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') Jul 03 04:18:36.099650 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:18:36.099650 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:36.100170 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:36.100514 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:18:36.101177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.101177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.101177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:18:36.102756 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.102756 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37698ff8-3950-5a1c-b829-19f20f6fc6f0', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.104062 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.104062 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:36.109227 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070 --force-share --output=json" returned: 0 in 0.083s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:36.109784 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070,backing_fmt=raw /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.rescue {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:36.121437 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:36.126283 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:36.137390 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.140174 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:36.142461 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.147177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.147177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadede961-4d, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.147177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadede961-4d, col_values=(('qos', UUID('680f1e89-eea0-4d27-ae95-16f1c9ab281b')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.147177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadede961-4d, col_values=(('external_ids', {'iface-id': 'adede961-4ddb-4591-bc2b-9ee9955e955c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:06:72', 'vm-uuid': '5920b3d1-e894-469e-a7f1-add334ef4da8'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:36.147577 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.149161 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:36.151266 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.156937 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.161539 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8c05472b9279949f9e9859963f0b368ad865070,backing_fmt=raw /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.rescue" returned: 0 in 0.052s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:36.162014 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "a8c05472b9279949f9e9859963f0b368ad865070" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.147s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:36.162386 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'migration_context' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.171208 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.171542 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.181124 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.181400 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:36.184049 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:36.184561 np0000004364 nova-compute[98951]: INFO os_vif [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') Jul 03 04:18:36.219756 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] Jul 03 04:18:36.219756 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] successful. Jul 03 04:18:36.219756 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.228655 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] Jul 03 04:18:36.228655 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] successful. Jul 03 04:18:36.228655 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.230301 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.242902 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.254812 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.255060 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:36.255431 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:36.255552 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:36.257077 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] HCTL ('11', '-', '-', 0) found on session 13 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:36.257244 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:36.271568 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:36.273368 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:36.273368 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:36.276869 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] HCTL ('12', '-', '-', 0) found on session 14 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:36.276869 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:36.283671 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 13 and hctl ['11', '*', '*', 0] yield: None {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:36.296806 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 14 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:36.296994 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:36.472279 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:36.537571 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:36.537763 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:36.665685 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:36.666003 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:18:36.666663 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Start _get_guest_xml network_info=[{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:e7:c0:dc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue={'image_id': 'ae06652b-203f-4a25-bafb-13418af32f29', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': '7502e94c-0523-43ec-b012-f350cc43d8f0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'fab3fe2f-7444-4177-a9ff-0e9b068efe7c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'serial': 'bcb76750-01eb-4c87-981b-f0879455c8bd'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:18:36.666818 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'resources' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:36.974824 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Took 1.43 seconds to deallocate network for instance. Jul 03 04:18:37.041278 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lazy-loading 'flavor' on Instance uuid 29fd1525-8166-4498-b726-4199f68e7deb {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:37.168647 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:37.170889 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:18:37.172498 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1980795871', uuid='fab3fe2f-7444-4177-a9ff-0e9b068efe7c'), owner=OwnerMeta(userid='4937ea515754406fa0fc0d376433084d', username='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member', projectid='80f331cd7f014a0eb91a6c479ad14d3f', projectname='tempest-ServerBootFromVolumeStableRescueTest-1451627323'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:e7:c0:dc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052317.1719635) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:18:37.176024 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:18:37.177007 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:18:37.177526 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:18:37.177526 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:18:37.179388 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:18:37.180363 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:18:37.180363 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:18:37.180363 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:18:37.180363 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:18:37.180363 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:18:37.180642 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:18:37.180642 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:18:37.180774 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:18:37.180912 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:18:37.181087 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:18:37.181235 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:18:37.181438 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'vcpu_model' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:37.284346 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 13 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:37.284493 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:37.312855 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:37.313289 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "944f22bd-e9ac-4a28-8278-623847d01847" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:37.543712 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Took 0.57 seconds to detach 1 volumes for instance. Jul 03 04:18:37.683404 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:37.693016 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:37.717680 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:37.718166 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:37.718357 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] No VIF found with MAC fa:16:3e:bd:96:94, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:37.718709 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] No VIF found with MAC fa:16:3e:1f:1d:0c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:37.720813 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Using config drive Jul 03 04:18:37.760893 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config --force-share --output=json" returned: 0 in 0.068s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:37.761366 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "/opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:37.761597 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:37.762149 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:37.762485 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:37.762952 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:37.763065 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:37.816783 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lazy-loading 'flavor' on Instance uuid 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:38.050757 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:38.053046 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:38.053318 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:38.116383 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Found WWN 3300000000024c8c2 for multipath device dm-4 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:38.116758 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:38.117004 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000000024c8c2', 'path': '/dev/dm-4', 'multipath_id': '3300000000024c8c2'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:38.117127 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000024c8c2', 'path': '/dev/dm-4', 'multipath_id': '3300000000024c8c2'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:38.118078 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.355s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:38.118393 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:38.120091 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'flavor' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:38.133082 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:38.134231 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:38.134685 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:38.134957 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:38.135418 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:38.135649 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:38.148133 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:38.155107 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:38.169690 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:38.170683 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.191981 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:38.192412 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:38.192765 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:38.193165 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('8', '0', '0', 0) found on session 4 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:38.193260 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('7', '0', '0', 0) found on session 3 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:38.196574 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:38.204972 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 4 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:38.205145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:38.208247 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 3 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:38.208464 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:38.230529 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:38.404717 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Creating config drive at /opt/stack/data/nova/instances/5920b3d1-e894-469e-a7f1-add334ef4da8/disk.config Jul 03 04:18:38.412031 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5920b3d1-e894-469e-a7f1-add334ef4da8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf6um4zqx {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:38.445097 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5920b3d1-e894-469e-a7f1-add334ef4da8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf6um4zqx" returned: 0 in 0.033s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:38.618752 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:38.618997 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:38.624873 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Attempting to attach volume 5eb4de56-65f0-42be-9fa8-65917cfadb53 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] attach device xml: Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: 5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: Jul 03 04:18:38.626116 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:18:38.823590 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "944f22bd-e9ac-4a28-8278-623847d01847" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:39.029830 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.087681 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.123687 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:39.136510 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.139662 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:39.255416 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.277806 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-bd999a48-3a60-4b55-8b23-27988e0069a7 req-68399f5c-4090-4e83-8e99-c3e8037b91a1 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:39.278133 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bd999a48-3a60-4b55-8b23-27988e0069a7 req-68399f5c-4090-4e83-8e99-c3e8037b91a1 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:39.279720 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bd999a48-3a60-4b55-8b23-27988e0069a7 req-68399f5c-4090-4e83-8e99-c3e8037b91a1 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:39.279881 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bd999a48-3a60-4b55-8b23-27988e0069a7 req-68399f5c-4090-4e83-8e99-c3e8037b91a1 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:39.280029 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-bd999a48-3a60-4b55-8b23-27988e0069a7 req-68399f5c-4090-4e83-8e99-c3e8037b91a1 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:39.288465 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.291784 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.310193 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.363016 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.410485 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.412569 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.436792 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.440868 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.479792 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.505249 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.529249 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.573253 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.598153 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2583cdfb-75ed-4256-a17e-12537b5697cb req-cd0f22bf-37d0-4557-9ed4-2eefc7bb15ce service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:39.603683 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2583cdfb-75ed-4256-a17e-12537b5697cb req-cd0f22bf-37d0-4557-9ed4-2eefc7bb15ce service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:39.603917 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2583cdfb-75ed-4256-a17e-12537b5697cb req-cd0f22bf-37d0-4557-9ed4-2eefc7bb15ce service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:39.604128 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2583cdfb-75ed-4256-a17e-12537b5697cb req-cd0f22bf-37d0-4557-9ed4-2eefc7bb15ce service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:39.604347 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2583cdfb-75ed-4256-a17e-12537b5697cb req-cd0f22bf-37d0-4557-9ed4-2eefc7bb15ce service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:39.639217 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.586s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:39.641277 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.707520 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Deleted allocations for instance c59ee2c0-5f4a-4173-a9ba-6d35fab9671d Jul 03 04:18:39.714570 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.750317 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:39.750514 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:39.751381 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Attaching volume 8320377d-dc3b-4381-a874-85023a1bf8c2 to /dev/sdc Jul 03 04:18:39.766726 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.769528 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.800164 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.804112 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.822872 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:39.827557 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-016d7560-3c87-4900-bb8e-75cfa7fc3a9a req-145e00d8-38b2-4bf1-9d62-e2e2bd390992 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:39.827801 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-016d7560-3c87-4900-bb8e-75cfa7fc3a9a req-145e00d8-38b2-4bf1-9d62-e2e2bd390992 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:39.828023 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-016d7560-3c87-4900-bb8e-75cfa7fc3a9a req-145e00d8-38b2-4bf1-9d62-e2e2bd390992 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:39.830014 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-016d7560-3c87-4900-bb8e-75cfa7fc3a9a req-145e00d8-38b2-4bf1-9d62-e2e2bd390992 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:39.830014 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-016d7560-3c87-4900-bb8e-75cfa7fc3a9a req-145e00d8-38b2-4bf1-9d62-e2e2bd390992 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:39.839763 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:39.871027 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:39.889519 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.908806 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:39.912346 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:39.913491 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:39.922666 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:39.924994 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672'] Jul 03 04:18:39.925112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:39.925220 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:39.925472 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:39.925649 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Updating existing volume attachment record: 11cc19b8-d141-4a6b-a7ea-a38c26b088b4 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:40.013271 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.026740 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.028636 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.059951 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.154665 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Found WWN 33000000040a09d61 for multipath device dm-0 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:40.155285 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:40.155567 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== connect_volume: return (2392ms) {'type': 'block', 'scsi_wwn': '33000000040a09d61', 'path': '/dev/dm-0', 'multipath_id': '33000000040a09d61'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:40.155792 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000040a09d61', 'path': '/dev/dm-0', 'multipath_id': '33000000040a09d61'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:40.300799 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.307409 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.415312 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:40.415486 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:40.415647 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:40.415782 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No VIF found with MAC fa:16:3e:5e:5c:89, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:40.460412 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.466045 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.501228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:40.501228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "944f22bd-e9ac-4a28-8278-623847d01847" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:40.501828 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Attaching volume 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a to /dev/vdb Jul 03 04:18:40.504511 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:40.504511 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8320377d-dc3b-4381-a874-85023a1bf8c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:40.504511 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:40.504511 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:40.504511 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8320377d-dc3b-4381-a874-85023a1bf8c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:40.518291 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:40.519361 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:40.519861 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:40.520120 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:40.520758 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:40.521010 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:40.533774 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:40.533774 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:40.543065 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:40.543065 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2] added Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:40.548429 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:40.548690 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:40.548766 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:40.550361 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:40.555348 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2] added Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:40.561077 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:40.561257 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:40.561440 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0404(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:40.561646 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:40.573474 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:40.600496 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:40.632922 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:40.633053 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:40.641773 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.642966 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:40.644837 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672'] Jul 03 04:18:40.644990 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:40.645091 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:40.645311 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:40.645564 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Updating existing volume attachment record: 30b27f7d-16b4-43c0-b74b-5a6f09f57500 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:40.648538 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.662649 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1980795871',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1980795871',id=10,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:18:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-s0ffab9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:28Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=fab3fe2f-7444-4177-a9ff-0e9b068efe7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:e7:c0:dc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:18:40.662649 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:e7:c0:dc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:40.662888 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:40.663453 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'pci_devices' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:40.720687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-63ee49ac-ace2-4de6-8d31-2fa0199ae6de tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Lock "c59ee2c0-5f4a-4173-a9ba-6d35fab9671d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.159s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:40.726768 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:40.726954 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] VM Started (Lifecycle Event) Jul 03 04:18:40.969928 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.979678 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:40.981797 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:41.003972 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:41.005127 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:41.160194 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:41.165782 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] End _get_guest_xml xml= Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: instance-0000000a Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 196608 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-server-1980795871 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 2026-07-03 04:18:37 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 192 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: True Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: bare Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 0 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: ide Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: pc Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: virtio Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: hvm Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 128 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: 1 Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: bcb76750-01eb-4c87-981b-f0879455c8bd Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: Jul 03 04:18:41.167106 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:18:41.170573 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance destroyed successfully. Jul 03 04:18:41.200132 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:18:41.200481 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:41.200600 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:41.223627 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:41.229310 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:41.231075 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:41.232716 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:41.232953 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] VM Paused (Lifecycle Event) Jul 03 04:18:41.348149 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.348403 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.348631 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.348772 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.348962 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No event matching network-vif-plugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba in dict_keys([('network-vif-plugged', '362342a9-83a3-4b70-a87b-9f6857c94d27'), ('network-vif-plugged', '29c965bb-06bd-4c50-a7d8-04a4aca7b4a9'), ('network-vif-plugged', '8533514e-4a12-45ce-9ce9-6659da1572d7'), ('network-vif-plugged', 'adede961-4ddb-4591-bc2b-9ee9955e955c')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:41.349116 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba for instance with vm_state building and task_state spawning. Jul 03 04:18:41.349243 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.349479 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.353050 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.353406 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.353872 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:41.354132 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.354300 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.354501 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.354716 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.354818 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No event matching network-vif-plugged-362342a9-83a3-4b70-a87b-9f6857c94d27 in dict_keys([('network-vif-plugged', '29c965bb-06bd-4c50-a7d8-04a4aca7b4a9'), ('network-vif-plugged', '8533514e-4a12-45ce-9ce9-6659da1572d7'), ('network-vif-plugged', 'adede961-4ddb-4591-bc2b-9ee9955e955c')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:41.354818 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-362342a9-83a3-4b70-a87b-9f6857c94d27 for instance with vm_state building and task_state spawning. Jul 03 04:18:41.355112 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.355247 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.355404 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.355540 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.355685 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:41.355919 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.356155 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.356354 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.356444 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.356592 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No event matching network-vif-plugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 in dict_keys([('network-vif-plugged', '8533514e-4a12-45ce-9ce9-6659da1572d7'), ('network-vif-plugged', 'adede961-4ddb-4591-bc2b-9ee9955e955c')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:41.356761 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 for instance with vm_state building and task_state spawning. Jul 03 04:18:41.357122 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.357266 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.357457 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.357582 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.357706 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:41.357863 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.358030 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.358176 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.358310 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.358459 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No event matching network-vif-plugged-adede961-4ddb-4591-bc2b-9ee9955e955c in dict_keys([('network-vif-plugged', '8533514e-4a12-45ce-9ce9-6659da1572d7')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:41.358558 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-af0e7ab3-b571-4f77-9ced-0f21b7019949 req-4fb62874-cc43-44a9-8ea6-47390712a65b service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-adede961-4ddb-4591-bc2b-9ee9955e955c for instance with vm_state building and task_state spawning. Jul 03 04:18:41.549433 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:41.561227 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.563192 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:41.573900 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:41.579678 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.592512 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.598449 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.598909 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.614645 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.615129 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:41.658137 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.50.100,3260] Jul 03 04:18:41.658137 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.50.100,3260] successful. Jul 03 04:18:41.658137 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.664415 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2bc1d820-cfe3-4f70-af29-5b8ce53fedff req-5fc4b598-54fc-4a3b-85ac-dc114959a647 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.664561 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2bc1d820-cfe3-4f70-af29-5b8ce53fedff req-5fc4b598-54fc-4a3b-85ac-dc114959a647 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.664670 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2bc1d820-cfe3-4f70-af29-5b8ce53fedff req-5fc4b598-54fc-4a3b-85ac-dc114959a647 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.664800 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2bc1d820-cfe3-4f70-af29-5b8ce53fedff req-5fc4b598-54fc-4a3b-85ac-dc114959a647 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.664980 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2bc1d820-cfe3-4f70-af29-5b8ce53fedff req-5fc4b598-54fc-4a3b-85ac-dc114959a647 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No event matching network-vif-plugged-990dad4f-21fa-472f-bf2e-4d119a9720ce in dict_keys([('network-vif-plugged', '8533514e-4a12-45ce-9ce9-6659da1572d7')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:41.665157 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2bc1d820-cfe3-4f70-af29-5b8ce53fedff req-5fc4b598-54fc-4a3b-85ac-dc114959a647 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-990dad4f-21fa-472f-bf2e-4d119a9720ce for instance with vm_state building and task_state spawning. Jul 03 04:18:41.669237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.40.100,3260] Jul 03 04:18:41.669237 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.40.100,3260] successful. Jul 03 04:18:41.669237 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.674255 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.681652 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.693926 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.694243 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:41.694583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:41.694583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:41.695694 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:41.695806 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.701942 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:41.702446 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:41.702918 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:41.702918 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:41.703946 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:41.704097 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:41.715744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:41.715744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8320377d-dc3b-4381-a874-85023a1bf8c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:41.721487 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:41.721487 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8320377d-dc3b-4381-a874-85023a1bf8c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:41.735223 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:41.736380 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:41.900422 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.900422 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.900422 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.900422 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.901157 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No event matching network-vif-plugged-19674044-1b8a-481a-8591-21c98341631c in dict_keys([('network-vif-plugged', '8533514e-4a12-45ce-9ce9-6659da1572d7')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:18:41.901407 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-19674044-1b8a-481a-8591-21c98341631c for instance with vm_state building and task_state spawning. Jul 03 04:18:41.901649 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.901897 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.902116 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.902369 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.902596 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Processing event network-vif-plugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:18:41.903366 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-plugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:41.903977 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:18:41.904750 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:41.904750 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:41.904750 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:41.904750 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-plugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:41.904750 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-69a6a9ec-b423-4b30-ac11-40e1c5298b2b req-3b155f39-4bce-4c5c-a845-fb4726cbaff9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received unexpected event network-vif-plugged-8533514e-4a12-45ce-9ce9-6659da1572d7 for instance with vm_state building and task_state spawning. Jul 03 04:18:41.907786 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:18:41.909075 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance spawned successfully. Jul 03 04:18:41.909493 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:18:41.967393 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a74e31ec-5f04-4f07-9f14-3af53b1fc1af tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.583s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:42.128049 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:42.128189 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:42.240723 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:42.241031 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:42.241063 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] VM Resumed (Lifecycle Event) Jul 03 04:18:42.417348 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:42.417348 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:42.417348 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:42.417348 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:42.417348 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:42.417348 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:18:42.520166 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:42.630079 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:18:42.693680 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:42.693918 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:42.694058 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:42.694224 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No VIF found with MAC fa:16:3e:e7:c0:dc, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:42.694859 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Using config drive Jul 03 04:18:42.745071 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:42.748227 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:42.924252 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Took 32.38 seconds to spawn the instance on the hypervisor. Jul 03 04:18:42.924252 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:43.197801 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'ec2_ids' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:43.207515 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:43.207789 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:43.210499 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:18:43.210652 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Claim successful on node np0000004364 Jul 03 04:18:43.250122 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:18:43.435218 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Took 45.42 seconds to build instance. Jul 03 04:18:43.538343 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Found WWN 330000000dedc5f79 for multipath device dm-7 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:43.539402 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:43.539402 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000dedc5f79', 'path': '/dev/dm-7', 'multipath_id': '330000000dedc5f79'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:43.539402 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dedc5f79', 'path': '/dev/dm-7', 'multipath_id': '330000000dedc5f79'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:43.539711 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.339s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:43.540041 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:18:43.546341 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lazy-loading 'flavor' on Instance uuid 29fd1525-8166-4498-b726-4199f68e7deb {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:43.552098 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:43.552924 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:43.553285 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:43.553509 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:43.554059 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:43.554372 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:43.575431 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:43.575431 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:43.575431 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:18:43.575431 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a] added Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:43.585960 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:43.586223 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:43.587078 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:43.587301 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a] added Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:18:43.589221 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:43.589496 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:18:43.589704 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:18:43.589901 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:18:43.618275 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:43.703715 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:43.703889 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'keypairs' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:43.936182 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6be06444-ad64-4ebe-a8e6-955fd1e05319 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 46.929s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] attach device xml: Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: 8320377d-dc3b-4381-a874-85023a1bf8c2 Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]:
Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: Jul 03 04:18:44.050333 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:18:44.206205 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:44.208860 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:44.354984 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Creating config drive at /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config.rescue Jul 03 04:18:44.362975 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2rskl2t4 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:44.403284 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2rskl2t4" returned: 0 in 0.040s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:44.589417 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:18:44.590718 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Stashing vm_state: active {{(pid=98951) _prep_resize /opt/stack/nova/nova/compute/manager.py:6345}} Jul 03 04:18:44.766257 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:44.768944 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:18:44.784759 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.802802 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.803229 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.829250 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.829689 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.837953 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.838366 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:44.894430 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.40.100,3260] Jul 03 04:18:44.894430 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.40.100,3260] successful. Jul 03 04:18:44.894430 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.900412 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:44.919780 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.920948 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.50.100,3260] Jul 03 04:18:44.920948 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.50.100,3260] successful. Jul 03 04:18:44.920948 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.939798 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.946745 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:44.948642 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.394s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:44.948642 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:44.948642 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:44.951102 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:44.951839 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Scanning host 19 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:44.973415 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:44.973682 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:44.978237 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:44.979291 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.425s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:44.979291 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:18:44.980172 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:18:44.980288 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Scanning host 20 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:18:45.007751 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:18:45.007751 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:18:45.058776 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:45.121216 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:45.122607 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:45.152618 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:45.152945 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:45.169450 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0f8b0dec-8ce5-49cf-b748-e33610965d65 req-4e22743d-5a61-452d-a347-56e9bb0a43a4 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:45.170302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0f8b0dec-8ce5-49cf-b748-e33610965d65 req-4e22743d-5a61-452d-a347-56e9bb0a43a4 service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:45.170644 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0f8b0dec-8ce5-49cf-b748-e33610965d65 req-4e22743d-5a61-452d-a347-56e9bb0a43a4 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:45.171850 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0f8b0dec-8ce5-49cf-b748-e33610965d65 req-4e22743d-5a61-452d-a347-56e9bb0a43a4 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:45.173695 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0f8b0dec-8ce5-49cf-b748-e33610965d65 req-4e22743d-5a61-452d-a347-56e9bb0a43a4 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:45.174166 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-0f8b0dec-8ce5-49cf-b748-e33610965d65 req-4e22743d-5a61-452d-a347-56e9bb0a43a4 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state rescuing. Jul 03 04:18:45.336433 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:45.479370 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-changed-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:45.484134 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing instance network info cache due to event network-changed-fe950017-4bf0-4122-ac89-ebd512e7c5ba. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:45.484621 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] Acquiring lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:45.484782 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] Acquired lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:45.484963 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Refreshing network info cache for port fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:45.555311 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:18:45.656881 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:45.777403 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No BDM found with device name sda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:45.777403 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:45.777403 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:45.777403 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] No VIF found with MAC fa:16:3e:88:b9:0e, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:45.837561 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for fab3fe2f-7444-4177-a9ff-0e9b068efe7c due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:18:45.837705 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:45.837838 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Resumed (Lifecycle Event) Jul 03 04:18:45.842895 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a9307561-0a69-445a-9361-bdd041774ce3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:45.987572 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:46.161877 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:46.165258 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.957s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:46.166140 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.830s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:46.166425 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:18:46.341516 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:46.344220 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:46.346638 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:46.507140 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updated VIF entry in instance network info cache for port fe950017-4bf0-4122-ac89-ebd512e7c5ba. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:18:46.507832 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [{"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:46.573777 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Found WWN 3300000002922e704 for multipath device dm-8 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:18:46.573777 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:46.574270 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] <== connect_volume: return (5373ms) {'type': 'block', 'scsi_wwn': '3300000002922e704', 'path': '/dev/dm-8', 'multipath_id': '3300000002922e704'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:46.574270 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002922e704', 'path': '/dev/dm-8', 'multipath_id': '3300000002922e704'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:18:46.577637 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lazy-loading 'flavor' on Instance uuid 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:46.674578 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:18:46.674860 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:18:46.675142 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:46.675410 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:46.680930 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:18:46.683146 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Claim successful on node np0000004364 Jul 03 04:18:46.838885 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Unrescuing Jul 03 04:18:46.839060 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:46.839161 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:46.839282 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:46.852214 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 03 04:18:46.852470 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:46.852642 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Started (Lifecycle Event) Jul 03 04:18:46.908258 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4e5d28fd9a54e719cf8264756f3915f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b71dccbd489492bb2cbdb93a1ba716e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:18:47.011686 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3292f62c-9a3a-439f-9ddb-e0e145ee0262 req-335dbf6d-3edb-4092-bb70-0a9856f291b2 service nova] Releasing lock "refresh_cache-5920b3d1-e894-469e-a7f1-add334ef4da8" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:47.080360 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Attempting to attach volume 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] attach device xml: Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: Jul 03 04:18:47.080923 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:18:47.189873 np0000004364 nova-compute[98951]: INFO nova.compute.resource_tracker [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating resource usage from migration dc66aa5d-f0f5-438a-a414-c780ef0478b1 Jul 03 04:18:47.192968 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:18:47.244582 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ea316e85-ffbd-4bff-80d5-0ff49b715764 req-1478dfd4-08d1-4f4d-9e15-0afc88796f19 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:47.244582 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ea316e85-ffbd-4bff-80d5-0ff49b715764 req-1478dfd4-08d1-4f4d-9e15-0afc88796f19 service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:47.244582 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ea316e85-ffbd-4bff-80d5-0ff49b715764 req-1478dfd4-08d1-4f4d-9e15-0afc88796f19 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:47.244582 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ea316e85-ffbd-4bff-80d5-0ff49b715764 req-1478dfd4-08d1-4f4d-9e15-0afc88796f19 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:47.244582 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ea316e85-ffbd-4bff-80d5-0ff49b715764 req-1478dfd4-08d1-4f4d-9e15-0afc88796f19 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:47.244582 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ea316e85-ffbd-4bff-80d5-0ff49b715764 req-1478dfd4-08d1-4f4d-9e15-0afc88796f19 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state rescued and task_state unrescuing. Jul 03 04:18:47.329228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-faccdcb8-a536-4e9f-809e-22b769ec4704 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.578s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:47.341250 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:47.355677 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:47.358392 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:47.541945 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully created port: 252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:47.738031 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:47.740794 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:47.862371 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 03 04:18:48.000779 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully created port: c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:48.003302 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:48.003572 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:48.243184 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Detaching volume 8320377d-dc3b-4381-a874-85023a1bf8c2 Jul 03 04:18:48.292879 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Attempting to driver detach volume 8320377d-dc3b-4381-a874-85023a1bf8c2 from mountpoint /dev/sdc Jul 03 04:18:48.295992 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Found disk sdc by alias ua-8320377d-dc3b-4381-a874-85023a1bf8c2 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:18:48.297027 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Found disk sdc by alias ua-8320377d-dc3b-4381-a874-85023a1bf8c2 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:18:48.297183 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Attempting to detach device sdc from instance 29fd1525-8166-4498-b726-4199f68e7deb from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] detach device xml: Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: 8320377d-dc3b-4381-a874-85023a1bf8c2 Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]:
Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: Jul 03 04:18:48.297455 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:18:48.305202 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:48.308902 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Successfully detached device sdc from instance 29fd1525-8166-4498-b726-4199f68e7deb from the persistent domain config. Jul 03 04:18:48.309141 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] (1/8): Attempting to detach device sdc with device alias ua-8320377d-dc3b-4381-a874-85023a1bf8c2 from instance 29fd1525-8166-4498-b726-4199f68e7deb from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] detach device xml: Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: 8320377d-dc3b-4381-a874-85023a1bf8c2 Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]:
Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: Jul 03 04:18:48.309477 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:18:48.410723 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.002145526000049358 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:48.410929 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:48.411064 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.39149156499979654 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:48.411167 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=0.39138203399988925 future=) was cancelled while queued, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:48.411255 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:48.411731 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:48.411939 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] VM Stopped (Lifecycle Event) Jul 03 04:18:48.467054 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully created port: e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:48.488302 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-8320377d-dc3b-4381-a874-85023a1bf8c2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:18:48.490577 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-8320377d-dc3b-4381-a874-85023a1bf8c2 for instance 29fd1525-8166-4498-b726-4199f68e7deb {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:18:48.492857 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updating instance_info_cache with network_info: [{"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:48.497105 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Successfully detached device sdc from instance 29fd1525-8166-4498-b726-4199f68e7deb from the live domain config. Jul 03 04:18:48.497943 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:18:48.498271 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8320377d-dc3b-4381-a874-85023a1bf8c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:48.498449 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:48.498858 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:48.499280 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8320377d-dc3b-4381-a874-85023a1bf8c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:18:48.499485 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:18:48.506102 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:48.544695 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:18:48.545425 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', '16')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:48.546780 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2', '15')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:48.548340 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Resulting device map defaultdict(. at 0x76c458283b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'): ({'sdl'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:18:48.548630 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Removing multipathed devices sdm, sdl {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:18:48.548941 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Flush multipath device 330000000dedc5f79 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:18:48.583037 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:48.641315 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:48.689962 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:18:48.690174 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:18:48.691635 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:18:48.703056 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:18:48.703198 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:18:48.711764 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:18:48.718033 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:48.762531 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.40.100,3260] Jul 03 04:18:48.762531 np0000004364 nova-compute[98951]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.40.100,3260] successful. Jul 03 04:18:48.762531 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:48.774057 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:48.774629 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:48.774629 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:18:48.774629 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] No VIF found with MAC fa:16:3e:66:da:c5, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:18:48.790161 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:48.803477 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:48.856609 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.50.100,3260] Jul 03 04:18:48.856609 np0000004364 nova-compute[98951]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-8320377d-dc3b-4381-a874-85023a1bf8c2, portal: 192.168.50.100,3260] successful. Jul 03 04:18:48.856609 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:48.879214 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:48.879783 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:48.879938 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] <== disconnect_volume: return (381ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:48.880095 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:18:48.891004 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully created port: 583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:48.915257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-59444ace-221f-463a-a938-175bfacfbf78 None None] [instance: c59ee2c0-5f4a-4173-a9ba-6d35fab9671d] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:48.996809 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-fab3fe2f-7444-4177-a9ff-0e9b068efe7c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:48.996809 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'flavor' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:49.014513 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.849s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:49.014709 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Migrating Jul 03 04:18:49.014934 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:49.015062 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:49.216813 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Booting with volume 15755c61-ebdf-447d-8a59-65387db01927 at /dev/vda Jul 03 04:18:49.265142 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:49.277469 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:49.302851 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:49.322296 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully created port: f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:18:49.333624 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:49.333983 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:49.345348 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:49.347581 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc'] Jul 03 04:18:49.347746 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:49.348593 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:49.348929 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:49.349183 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating existing volume attachment record: 44ee3f42-5850-484d-bc5c-1ffbc3ae8dbd {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:49.431636 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lazy-loading 'flavor' on Instance uuid 29fd1525-8166-4498-b726-4199f68e7deb {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:49.518587 np0000004364 nova-compute[98951]: INFO nova.compute.rpcapi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jul 03 04:18:49.519523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:49.519953 np0000004364 nova-compute[98951]: DEBUG nova.compute.rpcapi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 03 04:18:49.528250 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:49.537370 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:49.554597 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:49.662702 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:49.724027 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:49.730347 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:49.858223 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999625792000188 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:49.859940 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997914078000122 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:49.860526 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997353788000055 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:49.864383 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance destroyed successfully. Jul 03 04:18:49.866070 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'numa_topology' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:49.909512 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8fe16595-a459-4e4f-a9a7-f33251723725 req-6c3cb47d-f169-4940-8196-7900553a0668 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:49.909695 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8fe16595-a459-4e4f-a9a7-f33251723725 req-6c3cb47d-f169-4940-8196-7900553a0668 service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:49.909915 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8fe16595-a459-4e4f-a9a7-f33251723725 req-6c3cb47d-f169-4940-8196-7900553a0668 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:49.910061 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8fe16595-a459-4e4f-a9a7-f33251723725 req-6c3cb47d-f169-4940-8196-7900553a0668 service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:49.910204 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8fe16595-a459-4e4f-a9a7-f33251723725 req-6c3cb47d-f169-4940-8196-7900553a0668 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:49.910388 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8fe16595-a459-4e4f-a9a7-f33251723725 req-6c3cb47d-f169-4940-8196-7900553a0668 service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state rescued and task_state unrescuing. Jul 03 04:18:49.944811 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:50.002910 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: 252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:50.057942 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:50.058092 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:50.058276 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:50.062206 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:50.062583 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-252ba38f-fd86-45a7-bde9-bf8990e3b9d8. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:50.062583 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:50.067404 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:50.067767 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port 252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:50.357951 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-c98d84a9-cb83-4157-b99d-8d8dd1b87a62 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "944f22bd-e9ac-4a28-8278-623847d01847" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.854s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:50.368594 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:18:50.442041 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-6388ba12-eae7-48a3-b804-b9b42c15efc4 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 2.701s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:50.480227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] volume_snapshot_create: create_info: {'snapshot_id': '2d8ec144-17b5-443a-8628-94cd99a89a41', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98951) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3761}} Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] snap xml: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: {{(pid=98951) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3702}} Jul 03 04:18:50.487648 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] Lazy-loading 'system_metadata' on Instance uuid 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:50.562237 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:50.575583 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:50.663090 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:50.713946 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-7f12fe42-b799-458b-8c46-90f7e74a8b1a tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] volume_snapshot_delete: delete_info: {'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'} {{(pid=98951) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3869}} Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [None req-7f12fe42-b799-458b-8c46-90f7e74a8b1a tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Traceback (most recent call last): Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4042, in volume_snapshot_delete Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] self._volume_snapshot_delete(context, instance, volume_id, Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3872, in _volume_snapshot_delete Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] if delete_info['type'] != 'qcow2': Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] ~~~~~~~~~~~^^^^^^^^ Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] KeyError: 'type' Jul 03 04:18:50.720826 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [None req-7f12fe42-b799-458b-8c46-90f7e74a8b1a tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4042, in volume_snapshot_delete Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3872, in _volume_snapshot_delete Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-3e8d4ce6-28c7-440a-bbd4-c128ca659fcc) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3601, in _volume_snapshot_update_status Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jul 03 04:18:50.782108 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server [None req-7f12fe42-b799-458b-8c46-90f7e74a8b1a tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] Exception during message handling: KeyError: 'type' Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4836, in volume_snapshot_delete Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4045, in volume_snapshot_delete Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4042, in volume_snapshot_delete Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3872, in _volume_snapshot_delete Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jul 03 04:18:50.793368 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server Jul 03 04:18:50.869373 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:50.870773 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:50.898781 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:50.902071 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:50.978234 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Booting with volume 4c52c8d5-59be-4011-adb3-f811202cc535 at /dev/vdb Jul 03 04:18:50.991030 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Traceback (most recent call last): Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.002960 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Jul 03 04:18:51.004630 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Traceback (most recent call last): Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3779, in volume_snapshot_create Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] self._volume_snapshot_create(context, instance, guest, Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.006648 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Jul 03 04:18:51.039162 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:51.057435 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2d8ec144-17b5-443a-8628-94cd99a89a41 could not be found. Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3779, in volume_snapshot_create Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2d8ec144-17b5-443a-8628-94cd99a89a41 could not be found. (HTTP 404) (Request-ID: req-6c68a361-f333-42b1-ade8-3e494e543418) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3601, in _volume_snapshot_update_status Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2d8ec144-17b5-443a-8628-94cd99a89a41 could not be found. Jul 03 04:18:51.061878 np0000004364 nova-compute[98951]: ERROR nova.virt.libvirt.driver Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server [None req-2f21ad98-9c52-48af-a227-4a3618ac1ef4 tempest-VolumesAssistedSnapshotsTest-1744627552 tempest-VolumesAssistedSnapshotsTest-1744627552-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4824, in volume_snapshot_create Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3782, in volume_snapshot_create Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3779, in volume_snapshot_create Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3729, in _volume_snapshot_create Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jul 03 04:18:51.068177 np0000004364 nova-compute[98951]: ERROR oslo_messaging.rpc.server Jul 03 04:18:51.076554 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.077861 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.082053 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:51.083585 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:51.125763 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:51.125974 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:51.134522 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:51.137658 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe88:b90e', 'fe80::d41b:1eff:fe9e:ff31', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc'] Jul 03 04:18:51.137658 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:51.137658 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:51.138119 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:51.138801 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating existing volume attachment record: fc564cfd-3d61-4da8-b0a3-8cd9c695e749 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:51.162894 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.273354 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:51.282660 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:51.282660 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:51.282660 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:51.282660 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:51.282660 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:51.285046 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Terminating instance Jul 03 04:18:51.374777 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-bc9fb9ef-6418-4493-82e8-7ed039609082 req-ebc12fd5-10b1-4f72-a113-a81b797b62b5 service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:51.385124 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:51.581965 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.614925 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:51.615109 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "944f22bd-e9ac-4a28-8278-623847d01847" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:51.782562 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:51.787521 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:18:51.809999 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.813521 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.827168 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for fab3fe2f-7444-4177-a9ff-0e9b068efe7c due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:18:51.827168 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:51.829277 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Resumed (Lifecycle Event) Jul 03 04:18:51.833044 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b6e5092-e31c-4510-85ac-2bf8719e4e7d tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:51.834481 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.841220 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.871010 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:51.987022 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:51.987782 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:51.987961 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:51.988118 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:51.988383 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:51.988450 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state None. Jul 03 04:18:51.988868 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:51.988868 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:51.988944 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:51.989049 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:51.989221 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:51.989357 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state None. Jul 03 04:18:51.989493 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:51.989638 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:51.989801 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:51.990160 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:51.990269 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:52.033776 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aa29fa2c-4f00-4fcb-bffa-4622ad512bb5 req-c17d3088-eaad-4026-a5a7-e49549e99d84 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:52.034113 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aa29fa2c-4f00-4fcb-bffa-4622ad512bb5 req-c17d3088-eaad-4026-a5a7-e49549e99d84 service nova] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:52.034273 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aa29fa2c-4f00-4fcb-bffa-4622ad512bb5 req-c17d3088-eaad-4026-a5a7-e49549e99d84 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:52.034402 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aa29fa2c-4f00-4fcb-bffa-4622ad512bb5 req-c17d3088-eaad-4026-a5a7-e49549e99d84 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:52.034518 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aa29fa2c-4f00-4fcb-bffa-4622ad512bb5 req-c17d3088-eaad-4026-a5a7-e49549e99d84 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] No waiting events found dispatching network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:52.034650 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aa29fa2c-4f00-4fcb-bffa-4622ad512bb5 req-c17d3088-eaad-4026-a5a7-e49549e99d84 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:52.087972 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.097157 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.117575 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Detaching volume 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a Jul 03 04:18:52.120942 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Instance destroyed successfully. Jul 03 04:18:52.121400 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lazy-loading 'resources' on Instance uuid 29fd1525-8166-4498-b726-4199f68e7deb {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:52.175983 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Attempting to driver detach volume 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a from mountpoint /dev/vdb Jul 03 04:18:52.179262 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Found disk vdb by alias ua-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:18:52.180353 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Found disk vdb by alias ua-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:18:52.184624 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Attempting to detach device vdb from instance 944f22bd-e9ac-4a28-8278-623847d01847 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] detach device xml: Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]:
Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: Jul 03 04:18:52.185112 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:18:52.194050 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Successfully detached device vdb from instance 944f22bd-e9ac-4a28-8278-623847d01847 from the persistent domain config. Jul 03 04:18:52.194382 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] (1/8): Attempting to detach device vdb with device alias ua-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a from instance 944f22bd-e9ac-4a28-8278-623847d01847 from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] detach device xml: Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: 19138a1f-4de3-42c9-b5cf-bdf9f8255d8a Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]:
Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: Jul 03 04:18:52.194786 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:18:52.333540 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:52.342822 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:52.492606 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:52.571361 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:52.625496 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1603732213',display_name='tempest-AttachSCSIVolumeTestJSON-server-1603732213',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachscsivolumetestjson-server-1603732213',id=4,image_ref='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvZi6hJObzlhiNZJw9ZmWC5JhwRMOxiYmCvDWqCTO62wV0PkjcGz+sVa1X0Pcf+oM/3IVD0Xz60UXinHk9ZUkxHOy+6tXlqv/A0ovI0/6NYshT5AXzRSfnbmAfxTxr4OQ==',key_name='tempest-keypair-172637224',keypairs=,launch_index=0,launched_at=2026-07-03T04:17:56Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='879afb1507f042ebbf29d91b8c5289c9',ramdisk_id='',reservation_id='r-o8k64q4x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e9d17e7-36d6-4c6a-9e37-a38c6c0d3348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2080416413',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2080416413-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7587acb8e89c425d807e8875a9c8cc6b',uuid=29fd1525-8166-4498-b726-4199f68e7deb,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:18:52.626113 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Converting VIF {"id": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "address": "fa:16:3e:88:b9:0e", "network": {"id": "0057a9a6-9650-49d7-922f-e1494c46381d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2007311692-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "879afb1507f042ebbf29d91b8c5289c9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a11c3-c2", "ovs_interfaceid": "a97a11c3-c2f8-42b8-bf85-08b12754ee60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:52.626288 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:52.626618 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:18:52.627988 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.628385 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa97a11c3-c2, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:52.631757 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.631757 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:52.631757 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.633178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.633178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2efc57b7-4081-4666-a191-de0a58cb8294) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:52.635467 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.635467 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:52.635467 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:52.637272 np0000004364 nova-compute[98951]: INFO os_vif [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b9:0e,bridge_name='br-int',has_traffic_filtering=True,id=a97a11c3-c2f8-42b8-bf85-08b12754ee60,network=Network(0057a9a6-9650-49d7-922f-e1494c46381d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a11c3-c2') Jul 03 04:18:52.637805 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Deleting instance files /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb_del Jul 03 04:18:52.638806 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Deletion of /opt/stack/data/nova/instances/29fd1525-8166-4498-b726-4199f68e7deb_del complete Jul 03 04:18:52.720257 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:52.734416 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a for instance 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:18:52.748260 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:52.779966 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Booting with volume 37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 at /dev/vdc Jul 03 04:18:52.830826 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:52.843761 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:18:52.847228 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:18:52.847464 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Started (Lifecycle Event) Jul 03 04:18:52.864515 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:52.892950 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:18:52.892950 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:18:52.902260 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:18:52.904007 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::f8d7:18ff:fe31:7f', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:fe66:dac5', 'fe80::3c37:c9ff:fe97:96c6', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc'] Jul 03 04:18:52.904007 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:18:52.904192 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:18:52.904502 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:52.904566 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating existing volume attachment record: 3e44b472-106a-4ad5-9c0f-9b8765ae9289 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:18:53.147152 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Took 1.36 seconds to destroy the instance on the hypervisor. Jul 03 04:18:53.148815 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:18:53.149310 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:18:53.149455 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:18:53.149805 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:53.222642 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:53.222901 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:53.223141 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:53.223368 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:53.223510 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:53.223801 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:53.223964 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-4f525035-347f-42bc-9f31-59300211f545 req-72f57d48-c53d-4600-9b87-3abaeaa5fafa service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received unexpected event network-vif-plugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with vm_state active and task_state None. Jul 03 04:18:53.280215 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:53.310593 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Starting migrate_disk_and_power_off {{(pid=98951) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12672}} Jul 03 04:18:53.340496 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.343184 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.352914 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:18:53.354630 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:18:53.366923 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.378077 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.397215 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.664082 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance destroyed successfully. Jul 03 04:18:53.666841 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:17:51Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:18:53.667089 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:53.667811 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:53.668043 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:18:53.669745 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.670068 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48061ba0-95, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:53.671367 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.674120 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:53.674120 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.674930 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.675114 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1428540c-dcb5-42b4-a7a4-4418fb0984dd) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:53.675625 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.676073 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:53.677122 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:53.682404 np0000004364 nova-compute[98951]: INFO os_vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') Jul 03 04:18:53.684176 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:18:53.684711 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:53.685006 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:53.685565 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:53.686048 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:18:53.686240 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:53.726536 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:53.727147 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:18:53.727692 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '13')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:53.728693 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '14')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:53.730318 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Resulting device map defaultdict(. at 0x76c4504e36a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'): ({'sdg'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:18:53.730627 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Removing multipathed devices sdf, sdg {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:18:53.731219 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flush multipath device 3300000000024c8c2 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:18:53.774051 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:53.828030 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:53.859726 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999679671999957 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:53.860109 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:18:53.860926 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99936997199984 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:53.862920 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Successfully detached device vdb from instance 944f22bd-e9ac-4a28-8278-623847d01847 from the live domain config. Jul 03 04:18:53.863752 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:18:53.864954 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:18:53.864954 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:18:53.887106 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:18:53.887342 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:18:53.888657 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:18:53.904583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:18:53.904583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:18:53.915535 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:53.966069 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] Jul 03 04:18:53.966069 np0000004364 nova-compute[98951]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] successful. Jul 03 04:18:53.966069 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:53.989960 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.002759 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.024019 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d6e7e9fa-ae60-497a-8f1f-a73e0341b378 req-61f25a92-6338-4608-8fc9-5c748f3f376c service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-deleted-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:54.024757 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-d6e7e9fa-ae60-497a-8f1f-a73e0341b378 req-61f25a92-6338-4608-8fc9-5c748f3f376c service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Neutron deleted interface a97a11c3-c2f8-42b8-bf85-08b12754ee60; detaching it from the instance and deleting it from the info cache Jul 03 04:18:54.026516 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d6e7e9fa-ae60-497a-8f1f-a73e0341b378 req-61f25a92-6338-4608-8fc9-5c748f3f376c service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Detach interface failed, port_id=a97a11c3-c2f8-42b8-bf85-08b12754ee60, reason: Instance 29fd1525-8166-4498-b726-4199f68e7deb could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:18:54.051718 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] Jul 03 04:18:54.051718 np0000004364 nova-compute[98951]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] successful. Jul 03 04:18:54.051718 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.075294 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.075294 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:54.075762 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.211s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:18:54.076167 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== disconnect_volume: return (391ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:54.076381 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:18:54.076523 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:18:54.079122 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:18:54.081605 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:54.114472 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:18:54.114780 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:18:54.114997 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:18:54.115191 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '17')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:54.116482 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a', '18')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:18:54.121184 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Resulting device map defaultdict(. at 0x76c450329c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'): ({'sdo'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:18:54.121518 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Removing multipathed devices sdn, sdo {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:18:54.121930 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Flush multipath device 3300000002922e704 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:18:54.128492 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:54.128755 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Acquiring lock "29fd1525-8166-4498-b726-4199f68e7deb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:54.128943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:54.129899 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Lock "29fd1525-8166-4498-b726-4199f68e7deb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:54.130046 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] No waiting events found dispatching network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:54.130173 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Received event network-vif-unplugged-a97a11c3-c2f8-42b8-bf85-08b12754ee60 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:54.130338 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:54.130489 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-c856fb16-4e16-4e1f-aee0-2be9422ac0d5. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:54.130633 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:54.130762 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:54.130825 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:54.159530 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:54.179636 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:54.179636 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:54.217195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:18:54.226875 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:54.255805 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:54.256987 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:18:54.256987 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_resize/disk /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:54.279476 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:18:54.279728 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] SCSI volumes sdn, sdo have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:18:54.281945 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:18:54.294636 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:18:54.294636 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:18:54.310569 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.346561 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.40.100,3260] Jul 03 04:18:54.346561 np0000004364 nova-compute[98951]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.40.100,3260] successful. Jul 03 04:18:54.346561 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.359133 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "cp -r /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_resize/disk /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk" returned: 0 in 0.102s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:54.359560 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_resize/disk.config /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:54.371362 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.382581 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.405702 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "cp -r /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_resize/disk.config /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config" returned: 0 in 0.046s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:54.406138 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_resize/disk.info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:18:54.422503 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.50.100,3260] Jul 03 04:18:54.422503 np0000004364 nova-compute[98951]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-19138a1f-4de3-42c9-b5cf-bdf9f8255d8a, portal: 192.168.50.100,3260] successful. Jul 03 04:18:54.422503 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.441691 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:18:54.442156 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:18:54.442293 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] <== disconnect_volume: return (577ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:18:54.442498 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:18:54.448553 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "cp -r /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_resize/disk.info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" returned: 0 in 0.042s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:18:54.473289 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:54.557819 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:54.558021 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:54.639002 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:54.709627 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:54.853174 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:54.947495 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:54.979722 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Took 1.83 seconds to deallocate network for instance. Jul 03 04:18:55.036256 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lazy-loading 'flavor' on Instance uuid 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:55.060574 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:18:55.077756 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:18:55.080291 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:18:55.080763 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Creating image(s) Jul 03 04:18:55.081251 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:18:55.081458 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Ensure instance console log exists: /opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:18:55.081792 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:55.082018 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:55.082201 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:55.291990 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:55.340156 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:55.340541 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-e621f500-6f8f-4957-8211-cc80133cca3f. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:55.340751 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:55.356007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:55.356312 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:55.356871 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:55.357160 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:55.357523 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:55.358270 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:55.358612 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:55.358849 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:55.359173 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state active and task_state resize_migrating. Jul 03 04:18:55.359362 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:55.359555 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:55.359733 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:55.359884 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:55.360032 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:55.360314 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-3f0aed0a-cdc7-4e3a-9f0d-8693be5df1bf req-882d3a91-bed8-4399-9b75-01d0a5cd5312 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state active and task_state resize_migrating. Jul 03 04:18:55.488718 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:55.488834 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:55.633521 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:55.645810 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:55.646089 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:55.720798 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Port 48061ba0-95c3-4156-9d02-bbcee76a06e5 binding to destination host np0000004364 is already ACTIVE {{(pid=98951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jul 03 04:18:55.777280 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:55.777537 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:55.859601 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:55.944766 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:56.042484 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0e1f3212-6e18-4ab6-9f6f-dd83057c9628 tempest-VolumesAssistedSnapshotsTest-1232327420 tempest-VolumesAssistedSnapshotsTest-1232327420-project-admin] Lock "944f22bd-e9ac-4a28-8278-623847d01847" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.427s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:56.108008 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:56.208103 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:56.208537 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:56.208681 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:56.262178 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:56.262500 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:56.279579 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:18:56.355621 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: 583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:56.399790 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:56.400106 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-583fc957-b34a-49b7-b85a-d99dce25a38c. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:56.400106 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:56.610115 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-dd03cd1d-43b7-41c4-a5f0-eb91d64ab5e3 req-ff8838b1-3cb7-456a-ab74-2870f3c39169 service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:56.610566 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:56.610718 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:56.729350 np0000004364 nova-compute[98951]: DEBUG nova.compute.rpcapi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 03 04:18:56.738548 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:56.738656 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:56.738820 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:56.767317 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:56.836146 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:57.112772 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:57.209961 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:57.278413 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.789s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:57.279962 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.646s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:57.282828 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:18:57.284348 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Claim successful on node np0000004364 Jul 03 04:18:57.362693 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Deleted allocations for instance 29fd1525-8166-4498-b726-4199f68e7deb Jul 03 04:18:57.381441 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Successfully updated port: f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:18:57.441239 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:57.447199 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:57.447523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:57.447620 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:57.749285 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:57.841907 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:57.842489 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:57.842667 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:18:57.885479 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:57.943027 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b7abd66a-1e96-4736-a612-ae2314519744 req-f283513f-d9ea-418c-8727-c0c90ef4a3dd service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:57.943515 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:57.943701 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port 583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:58.142776 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:58.142914 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:58.143059 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:58.143223 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:58.143427 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:58.145265 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Terminating instance Jul 03 04:18:58.347096 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:58.377893 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-9c294ec8-f990-4f3c-9be2-6587c2ff21f1 tempest-AttachSCSIVolumeTestJSON-2080416413 tempest-AttachSCSIVolumeTestJSON-2080416413-project-member] Lock "29fd1525-8166-4498-b726-4199f68e7deb" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.099s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:58.445474 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:58.536035 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:58.648160 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:18:58.680387 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:58.685975 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:58.708054 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:58.715563 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:58.739047 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:58.740461 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:58.770083 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:58.833733 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:58.970230 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:18:58.970367 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:18:58.986181 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999708914999928 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:18:58.987791 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Instance destroyed successfully. Jul 03 04:18:58.987949 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lazy-loading 'resources' on Instance uuid 944f22bd-e9ac-4a28-8278-623847d01847 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:18:59.026620 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:18:59.272991 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-711f09e6-e99d-4363-9139-45df61ea7db4 req-01426436-a81a-44cf-955b-009e1e806c56 service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:59.273209 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:59.273251 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:59.473151 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:18:59.490137 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2119366886',display_name='tempest-VolumesAssistedSnapshotsTest-server-2119366886',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-volumesassistedsnapshotstest-server-2119366886',id=5,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLOoHJhM2Epb5Gb+/QANUdFLOKe0Twps1BU5SZn1Bwp3Kfvt0Bdryhv7smNAT0YH7GByOsh1KKyIIqLHOwoORAHlYT0N/7wSYy9RMCiAbQMZiq4miGRsVcJZI/d+ZiTeg==',key_name='tempest-keypair-730387864',keypairs=,launch_index=0,launched_at=2026-07-03T04:17:58Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='58bbf86bcaa34d1fa4054c0afb4ac404',ramdisk_id='',reservation_id='r-fn7ea584',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-843449167',owner_user_name='tempest-VolumesAssistedSnapshotsTest-843449167-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13852c5a87aa4566850879e50e1779d3',uuid=944f22bd-e9ac-4a28-8278-623847d01847,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:18:59.490441 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Converting VIF {"id": "6dd00d98-7155-45e4-9f6f-c133145a9640", "address": "fa:16:3e:66:da:c5", "network": {"id": "b43ebf48-9f15-49e7-86b3-51fa1ea789aa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-73322927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58bbf86bcaa34d1fa4054c0afb4ac404", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dd00d98-71", "ovs_interfaceid": "6dd00d98-7155-45e4-9f6f-c133145a9640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:18:59.491073 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:18:59.491321 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:18:59.492540 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:59.492794 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dd00d98-71, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:59.493856 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:59.495865 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:59.496450 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:59.496581 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=496e4f3b-de51-4bc3-bb2b-9681ac81252e) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:18:59.497042 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:59.498466 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:18:59.500305 np0000004364 nova-compute[98951]: INFO os_vif [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=6dd00d98-7155-45e4-9f6f-c133145a9640,network=Network(b43ebf48-9f15-49e7-86b3-51fa1ea789aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dd00d98-71') Jul 03 04:18:59.500656 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Deleting instance files /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847_del Jul 03 04:18:59.501536 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Deletion of /opt/stack/data/nova/instances/944f22bd-e9ac-4a28-8278-623847d01847_del complete Jul 03 04:18:59.517070 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-unplugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:59.517189 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:59.517367 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:59.517516 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:59.517652 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] No waiting events found dispatching network-vif-unplugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:59.517753 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-unplugged-6dd00d98-7155-45e4-9f6f-c133145a9640 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:59.517844 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-unplugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:59.517957 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] Acquiring lock "944f22bd-e9ac-4a28-8278-623847d01847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:18:59.518515 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:59.519209 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] Lock "944f22bd-e9ac-4a28-8278-623847d01847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:59.519209 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] No waiting events found dispatching network-vif-unplugged-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:18:59.519209 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-37c61078-3fe5-4785-bb79-c1ab33cdafeb req-cbcf68f3-318f-49ce-893b-d49d74f951a9 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-unplugged-6dd00d98-7155-45e4-9f6f-c133145a9640 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:18:59.527383 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:18:59.646771 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-changed-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:18:59.646771 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Refreshing instance network info cache due to event network-changed-0d57f313-fcff-42ac-a3c3-e0139470d053. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:18:59.646771 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] Acquiring lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:18:59.646771 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] Acquired lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:18:59.646771 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Refreshing network info cache for port 0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:18:59.776608 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:18:59.841954 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:18:59.948517 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:18:59.984643 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.705s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:18:59.985186 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.149s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:18:59.985340 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:18:59.989185 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:18:59.989308 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Claim successful on node np0000004364 Jul 03 04:19:00.008927 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Took 1.36 seconds to destroy the instance on the hypervisor. Jul 03 04:19:00.009700 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:19:00.010049 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:19:00.010262 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:19:00.010600 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:00.030192 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:00.035370 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:00.048624 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:19:00.072867 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:00.109463 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:19:00.109818 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:19:00.119276 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:19:00.122202 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc'] Jul 03 04:19:00.122358 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:19:00.122489 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:19:00.122759 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:00.150885 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:00.154422 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:00.339309 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:00.339636 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:00.481248 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:00.495140 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:00.495487 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:00.495758 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:00.495988 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:00.535403 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1ece8abe-d248-4941-8019-702768f347ba req-e40c094a-119f-4c7c-9fb2-5cff0b40a382 service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:00.535732 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:00.535909 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:00.596740 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4937ea515754406fa0fc0d376433084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f331cd7f014a0eb91a6c479ad14d3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:00.651791 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updated VIF entry in instance network info cache for port 0d57f313-fcff-42ac-a3c3-e0139470d053. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:19:00.652014 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updating instance_info_cache with network_info: [{"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:00.846542 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'flavor' on Instance uuid c3e4ef2d-c122-479f-9d8c-af3a8725cb22 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:01.002982 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:19:01.040361 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Successfully created port: af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:19:01.145354 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:01.153907 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d9d5a901-4891-4672-b82a-39be8d2fa149 req-f29dccdf-0911-4029-96bc-e4c71f12606c service nova] Releasing lock "refresh_cache-e60c0794-599a-4409-8806-ee2697a55a78" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:01.247000 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:01.298874 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Starting finish_migration {{(pid=98951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12859}} Jul 03 04:19:01.300425 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance directory exists: not creating {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 03 04:19:01.301195 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Creating image(s) Jul 03 04:19:01.305800 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:01.388476 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:01.401346 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.095s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:01.401834 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:19:01.402085 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:01.480251 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:01.480670 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Cannot resize image /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:19:01.509349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:19:01.606989 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-00fa0aaf-810e-4a4d-9640-8c7827a39510 req-d3d5b4d8-f382-4d0c-8da8-0348c0d827a6 service nova] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Received event network-vif-deleted-6dd00d98-7155-45e4-9f6f-c133145a9640 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:01.686572 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Successfully updated port: af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:19:01.732476 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-changed-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:01.732682 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Refreshing instance network info cache due to event network-changed-1793304b-efe8-47f1-8d58-8af8edf0bc6c. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:01.733158 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] Acquiring lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:01.733263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] Acquired lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:01.733448 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Refreshing network info cache for port 1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:01.744908 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:01.745234 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:01.749559 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-changed-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:01.749725 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Refreshing instance network info cache due to event network-changed-af1aae67-b7a7-4adf-928b-f342e6653627. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:01.749850 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] Acquiring lock "refresh_cache-c44b3de1-d811-402b-9852-c5bb063fdcb1" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:01.749970 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] Acquired lock "refresh_cache-c44b3de1-d811-402b-9852-c5bb063fdcb1" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:01.750125 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Refreshing network info cache for port af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:01.755295 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Took 1.74 seconds to deallocate network for instance. Jul 03 04:19:01.790523 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:01.857593 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:01.983558 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:19:01.983649 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Ensure instance console log exists: /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:01.983977 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:01.984134 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:01.984244 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:01.987012 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start _get_guest_xml network_info=[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'attachment_id': 'a47d42a9-d00c-4e0e-bf26-1799c60f70a4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '985dc90b-e484-4add-b0d7-c37a5f952ce6', 'attached_at': '2026-07-03T04:19:00.000000', 'detached_at': '', 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'serial': '5eb4de56-65f0-42be-9fa8-65917cfadb53'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:01.991965 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:01.993409 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-722411084', uuid='985dc90b-e484-4add-b0d7-c37a5f952ce6'), owner=OwnerMeta(userid='910e8830eace40529a20e5efded682cf', username='tempest-ServerActionsTestOtherB-1313095942-project-member', projectid='a71449bab216465bb9a55183718ff364', projectname='tempest-ServerActionsTestOtherB-1313095942'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052341.9929461) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:01.994319 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:01.994739 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:01.995623 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:01.995915 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:01.997037 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:01.997394 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:01.997580 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:01.997675 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:01.997792 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:01.997869 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:01.997955 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:01.998102 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:01.998192 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:01.998292 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:01.998425 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:01.998571 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:02.010485 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:02.094492 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config --force-share --output=json" returned: 0 in 0.084s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:02.094942 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:02.095205 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:02.095930 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:02.096299 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:02.096777 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:02.096971 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:02.097273 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:02.097704 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:02.110373 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:02.111064 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:02.111700 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:02.111967 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:02.112513 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:02.112724 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:02.115579 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:02.124364 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:02.124364 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:02.128873 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:02.128873 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53] added Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:02.133831 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:02.134073 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:02.134252 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:02.134464 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53] added Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:02.138680 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:02.138896 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:02.139048 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:02.139205 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:02.189613 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-c44b3de1-d811-402b-9852-c5bb063fdcb1" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:02.235453 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:02.249013 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:02.258802 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:02.263401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:02.358013 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:02.469802 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:02.533116 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:19:02.534301 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:19:02.534589 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Creating image(s) Jul 03 04:19:02.535126 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "/opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:02.538373 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:02.539295 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:02.541243 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:02.542102 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:02.547912 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:02.549588 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:02.627027 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.077s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:02.627460 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:02.628178 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:02.628687 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:02.631743 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:02.632312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:02.671599 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:02.728231 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.096s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:02.729226 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:02.764052 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.778s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:02.764949 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:19:02.768214 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.505s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:02.789436 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk 1073741824" returned: 0 in 0.060s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:02.789852 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.162s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:02.790207 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:02.871127 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.081s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:02.871588 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:19:02.871741 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:02.915866 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Updated VIF entry in instance network info cache for port 1793304b-efe8-47f1-8d58-8af8edf0bc6c. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:19:02.916822 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Updating instance_info_cache with network_info: [{"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:02.922078 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:02.947835 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:02.947835 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:02.948050 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Attaching volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 to /dev/vdb Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Cannot resize image /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Ensure instance console log exists: /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:02.979401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:03.000505 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:03.011747 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:19:03.034098 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:03.048286 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f9246955-318a-4faa-8fbd-2f22ecdd6bfe req-09a123d6-2e25-4c6d-9e22-530610554c39 service nova] Releasing lock "refresh_cache-c44b3de1-d811-402b-9852-c5bb063fdcb1" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:03.052687 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:03.058210 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-c44b3de1-d811-402b-9852-c5bb063fdcb1" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:03.058527 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:03.060273 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:19:03.060618 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:19:03.068092 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:19:03.069686 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc'] Jul 03 04:19:03.069912 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:19:03.070381 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:19:03.070541 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] <== get_connector_properties: return (69ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:03.070849 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Updating existing volume attachment record: 4ad18421-90cb-4f67-9d36-3566e3ba20e6 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:19:03.135171 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:03.140172 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:03.153871 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:03.159998 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.171641 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.177820 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.191246 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.192304 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.201268 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.201612 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:03.247223 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] Jul 03 04:19:03.247223 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] successful. Jul 03 04:19:03.247223 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.259510 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.268474 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] Jul 03 04:19:03.268474 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] successful. Jul 03 04:19:03.268474 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.285464 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:03.287634 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:03.288000 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:03.288339 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:03.288594 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.290419 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.290964 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:03.291723 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:03.291974 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:03.293412 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] HCTL ('11', '-', '-', 0) found on session 19 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:03.293582 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] HCTL ('12', '-', '-', 0) found on session 20 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:03.308892 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:03.313547 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:03.318160 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 19 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:03.318394 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:03.327521 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 20 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:03.328135 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:03.422393 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f382e83c876463dac1650a3f0272ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '662ad5b7bca441b387156b61f2272bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:03.424165 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-58b97637-7aee-47da-86af-48fa824af0a4 req-20fbd1ef-57dc-4a19-bee5-67e9be3e7de5 service nova] Releasing lock "refresh_cache-c3e4ef2d-c122-479f-9d8c-af3a8725cb22" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:03.640422 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:03.641423 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:03.641423 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:03.679856 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:03.682421 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:03.682806 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:03.758924 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:03.787633 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:19:03.902806 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:03.958160 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [{"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:03.985353 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Successfully created port: 37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:19:04.071927 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Updating instance_info_cache with network_info: [{"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:04.113458 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:04.185594 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:04.291082 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:19:04.460219 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:04.460768 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance network_info: |[{"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:19:04.462115 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Start _get_guest_xml network_info=[{"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': '44ee3f42-5850-484d-bc5c-1ffbc3ae8dbd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a17998b3-c8a4-48e0-b311-b828734699cc', 'attached_at': '', 'detached_at': '', 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'serial': '15755c61-ebdf-447d-8a59-65387db01927'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'attachment_id': 'fc564cfd-3d61-4da8-b0a3-8cd9c695e749', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a17998b3-c8a4-48e0-b311-b828734699cc', 'attached_at': '', 'detached_at': '', 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'serial': '4c52c8d5-59be-4011-adb3-f811202cc535'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'attachment_id': '3e44b472-106a-4ad5-9c0f-9b8765ae9289', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a17998b3-c8a4-48e0-b311-b828734699cc', 'attached_at': '', 'detached_at': '', 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'serial': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:04.463980 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:04.465578 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-938181740', uuid='a17998b3-c8a4-48e0-b311-b828734699cc'), owner=OwnerMeta(userid='a4e5d28fd9a54e719cf8264756f3915f', username='tempest-TaggedBootDevicesTest-904864538-project-member', projectid='9b71dccbd489492bb2cbdb93a1ba716e', projectname='tempest-TaggedBootDevicesTest-904864538'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052344.4650433) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:04.466562 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:04.466923 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:04.467886 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:04.468459 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:04.469070 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:04.469443 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:04.469640 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:04.469746 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:04.470138 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:04.470138 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:04.470138 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:04.470603 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:04.470603 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:04.470603 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:04.471154 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:04.471350 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:04.483905 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:04.484214 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:04.484377 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:04.497142 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:04.573976 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-c44b3de1-d811-402b-9852-c5bb063fdcb1" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:04.574485 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Instance network_info: |[{"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:19:04.576032 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Start _get_guest_xml network_info=[{"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:04.577527 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:04.578313 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1422264785', uuid='c44b3de1-d811-402b-9852-c5bb063fdcb1'), owner=OwnerMeta(userid='4937ea515754406fa0fc0d376433084d', username='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member', projectid='80f331cd7f014a0eb91a6c479ad14d3f', projectname='tempest-ServerBootFromVolumeStableRescueTest-1451627323'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052344.5779986) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:04.578928 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:04.579256 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:04.579821 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:04.579977 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:04.580662 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:04.580978 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:04.581151 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:04.581270 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:04.581442 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:04.581536 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:04.581650 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:04.581831 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:04.581953 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:04.582089 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:04.582219 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:04.582394 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:04.592508 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1422264785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1422264785',id=12,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-tkr9remd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:02Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=c44b3de1-d811-402b-9852-c5bb063fdcb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:04.592750 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:04.593189 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:04.594031 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'pci_devices' on Instance uuid c44b3de1-d811-402b-9852-c5bb063fdcb1 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:04.631633 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Successfully updated port: 37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:19:04.689284 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-changed-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:04.689722 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing instance network info cache due to event network-changed-37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:04.689909 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:04.690004 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:04.690115 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing network info cache for port 37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:04.695777 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.928s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:04.755012 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Deleted allocations for instance 944f22bd-e9ac-4a28-8278-623847d01847 Jul 03 04:19:04.858471 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004054019998420699 future=) was cancelled during its delay period, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:04.858471 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:04.858690 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.0006109299999935 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:04.858690 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.0005323159998625 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:04.956161 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] End _get_guest_xml xml= Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: c44b3de1-d811-402b-9852-c5bb063fdcb1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: instance-0000000c Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-server-1422264785 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 2026-07-03 04:19:04 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: True Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: bare Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: c44b3de1-d811-402b-9852-c5bb063fdcb1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: c44b3de1-d811-402b-9852-c5bb063fdcb1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: Jul 03 04:19:05.096522 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Preparing to wait for external event network-vif-plugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1422264785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1422264785',id=12,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-tkr9remd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:02Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=c44b3de1-d811-402b-9852-c5bb063fdcb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:05.098285 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:05.099296 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:05.099563 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.099736 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.100616 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:05.100669 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.100867 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd9b2e6f-64c7-51be-a343-50ec51d7d677', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.101528 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.102636 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:05.104500 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.104627 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf1aae67-b7, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.104890 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf1aae67-b7, col_values=(('qos', UUID('67085981-1d5b-4d15-bbfc-643e03eb299d')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.105038 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf1aae67-b7, col_values=(('external_ids', {'iface-id': 'af1aae67-b7a7-4adf-928b-f342e6653627', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:71:59', 'vm-uuid': 'c44b3de1-d811-402b-9852-c5bb063fdcb1'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.105758 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.107163 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:05.112061 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.112900 np0000004364 nova-compute[98951]: INFO os_vif [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') Jul 03 04:19:05.133591 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:05.135817 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Found WWN 3300000000024c8c2 for multipath device dm-4 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:05.136052 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:05.137518 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000000024c8c2', 'path': '/dev/dm-4', 'multipath_id': '3300000000024c8c2'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:05.137518 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000024c8c2', 'path': '/dev/dm-4', 'multipath_id': '3300000000024c8c2'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:05.137518 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.496s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:05.137518 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:05.152154 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:05.152154 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:05.152923 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:05.152923 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:05.156279 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:05.156436 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:05.164969 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:05.164969 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:05.172069 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:05.172069 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7] added Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:05.178352 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:05.178570 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:05.178726 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:05.178915 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7] added Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:05.182573 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:05.182740 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:05.182933 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0266(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:05.183075 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:05.191764 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:05.261817 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:05.281360 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.301287 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:19:05.303200 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:19:05.303867 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Creating image(s) Jul 03 04:19:05.305059 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:05.305206 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:05.305717 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:05.306271 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:05.309777 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:05.311028 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:05.384054 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.073s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:05.384456 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:05.384828 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:05.385295 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:05.388334 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:05.388796 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:05.439129 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:05.470602 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.082s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:05.471045 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:05.523162 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk 1073741824" returned: 0 in 0.052s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:05.523755 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.139s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:05.523998 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:05.600689 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.076s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:05.601164 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:19:05.601454 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:05.646320 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:17:51Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004364',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] End _get_guest_xml xml= Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: instance-00000002 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 262144 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-server-722411084 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 2026-07-03 04:19:01 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 256 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: True Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: bare Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: ide Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: pc Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-1313095942-project-member Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-1313095942 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: 5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:05.650347 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:17:51Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004364',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:05.654821 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1803441096-network", "vif_mac": "fa:16:3e:5e:5c:89"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:05.656119 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:05.656119 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:05.656715 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.657262 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.657832 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:05.659033 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.659287 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc1a688e-06fd-5b6f-bede-3ec958e4e0bf', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.660239 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.660972 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:05.666764 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.668824 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.669007 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48061ba0-95, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.669432 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48061ba0-95, col_values=(('qos', UUID('651701bc-56e0-44c3-adfe-0a0aa7779995')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.669622 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48061ba0-95, col_values=(('external_ids', {'iface-id': '48061ba0-95c3-4156-9d02-bbcee76a06e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:5c:89', 'vm-uuid': '985dc90b-e484-4add-b0d7-c37a5f952ce6'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:05.670488 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.671614 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:05.683961 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:05.685392 np0000004364 nova-compute[98951]: INFO os_vif [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') Jul 03 04:19:05.687352 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:05.687668 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Cannot resize image /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:19:05.687905 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:19:05.688026 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Ensure instance console log exists: /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:05.688267 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:05.688508 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:05.688632 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:05.771477 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-7b0f9469-3149-4ef5-a271-59d4d7f146f8 tempest-VolumesAssistedSnapshotsTest-843449167 tempest-VolumesAssistedSnapshotsTest-843449167-project-member] Lock "944f22bd-e9ac-4a28-8278-623847d01847" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.628s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:05.941945 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba4b2ae3-b7d6-42fd-8585-a9d7902e402c req-be1cca97-4d4e-412a-9e64-5a465181f64e service nova] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:05.942500 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:05.942741 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:06.179774 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:06.183813 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:06.193139 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:06.199005 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.205628 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.214720 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.225672 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.226024 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.231715 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.232026 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:06.270952 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.40.100,3260] Jul 03 04:19:06.270952 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.40.100,3260] successful. Jul 03 04:19:06.270952 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.282371 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.283280 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.50.100,3260] Jul 03 04:19:06.283280 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.50.100,3260] successful. Jul 03 04:19:06.283280 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.299600 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.300446 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.300888 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:06.301130 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:06.301130 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:06.302524 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] HCTL ('17', '-', '-', 0) found on session 21 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:06.302638 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:06.318068 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching for a device in session 21 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:06.318124 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.320502 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:06.320932 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:06.321277 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:06.321277 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:06.322545 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] HCTL ('18', '-', '-', 0) found on session 22 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:06.322597 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:06.338836 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching for a device in session 22 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:06.338836 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:06.514247 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:06.643894 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:06.644078 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:06.644300 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No VIF found with MAC fa:16:3e:f2:71:59, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:06.644831 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Using config drive Jul 03 04:19:06.699992 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:06.843844 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:07.150842 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:07.154923 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:07.211576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:07.211576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:07.211576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:07.211576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] No VIF found with MAC fa:16:3e:5e:5c:89, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:07.211576 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Using config drive Jul 03 04:19:07.317637 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Creating config drive at /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk.config Jul 03 04:19:07.323796 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ewfgq4b {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:07.345849 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:07.346771 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance network_info: |[{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:19:07.349566 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Start _get_guest_xml network_info=[{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:07.352598 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:07.354693 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-589779902', uuid='8797c544-317e-4ae4-9a84-512976e3225f'), owner=OwnerMeta(userid='9f382e83c876463dac1650a3f0272ec5', username='tempest-ServerStableDeviceRescueTest-645362785-project-member', projectid='662ad5b7bca441b387156b61f2272bff', projectname='tempest-ServerStableDeviceRescueTest-645362785'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052347.3542228) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:07.356085 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:07.356628 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:07.357806 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:07.358058 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:07.359397 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:07.359768 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:07.360438 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:07.360574 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:07.360712 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:07.360819 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:07.360914 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:07.361116 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:07.361721 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:07.361920 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:07.362086 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:07.362256 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:07.379313 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ewfgq4b" returned: 0 in 0.055s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:07.387238 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-589779902',display_name='tempest-ServerStableDeviceRescueTest-server-589779902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverstabledevicerescuetest-server-589779902',id=13,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/0M+SZsgUuhYAO8ZEsx9JJuvYP56lAldRqOM6z3mK1R0DTeikdK/ZpA8jv5jBrPjRCnsHJSpGqsSAmJXXGhuJHViZ1dOlN5jrnRcYNIqBz+90MB+7YvXEbLbXllV1M+A==',key_name='tempest-keypair-1663150320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='662ad5b7bca441b387156b61f2272bff',ramdisk_id='',reservation_id='r-srwxoga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-645362785',owner_user_name='tempest-ServerStableDeviceRescueTest-645362785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f382e83c876463dac1650a3f0272ec5',uuid=8797c544-317e-4ae4-9a84-512976e3225f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:07.387537 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converting VIF {"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:07.391454 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:07.392435 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'pci_devices' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] End _get_guest_xml xml= Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: instance-0000000d Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: tempest-ServerStableDeviceRescueTest-server-589779902 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 2026-07-03 04:19:07 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: True Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: bare Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: tempest-ServerStableDeviceRescueTest-645362785-project-member Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: tempest-ServerStableDeviceRescueTest-645362785 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: Jul 03 04:19:07.895534 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:07.897638 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Preparing to wait for external event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:07.897638 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:07.897638 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:07.897638 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:07.897638 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-589779902',display_name='tempest-ServerStableDeviceRescueTest-server-589779902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverstabledevicerescuetest-server-589779902',id=13,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/0M+SZsgUuhYAO8ZEsx9JJuvYP56lAldRqOM6z3mK1R0DTeikdK/ZpA8jv5jBrPjRCnsHJSpGqsSAmJXXGhuJHViZ1dOlN5jrnRcYNIqBz+90MB+7YvXEbLbXllV1M+A==',key_name='tempest-keypair-1663150320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='662ad5b7bca441b387156b61f2272bff',ramdisk_id='',reservation_id='r-srwxoga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-645362785',owner_user_name='tempest-ServerStableDeviceRescueTest-645362785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f382e83c876463dac1650a3f0272ec5',uuid=8797c544-317e-4ae4-9a84-512976e3225f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:07.897638 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converting VIF {"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:07.897893 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:07.898652 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:07.898652 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.898652 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:07.898989 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:07.899735 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.899936 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae6ed0fb-1f68-50ec-837e-7fdab47675c0', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:07.900737 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.901424 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:07.911372 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.914314 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.914515 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37f407be-ae, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:07.914914 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37f407be-ae, col_values=(('qos', UUID('10592403-6d10-4814-a6aa-1d7e593a4f31')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:07.915198 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37f407be-ae, col_values=(('external_ids', {'iface-id': '37f407be-ae70-442c-8286-abbac76c494d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:b5:97', 'vm-uuid': '8797c544-317e-4ae4-9a84-512976e3225f'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:07.916234 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.917816 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:07.932104 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:07.932877 np0000004364 nova-compute[98951]: INFO os_vif [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') Jul 03 04:19:07.990519 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.013553 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.135365 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.155704 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.178253 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.181145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Found WWN 3300000006af0b8f0 for multipath device dm-7 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:08.182519 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:08.182519 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] <== connect_volume: return (4540ms) {'type': 'block', 'scsi_wwn': '3300000006af0b8f0', 'path': '/dev/dm-7', 'multipath_id': '3300000006af0b8f0'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:08.182519 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006af0b8f0', 'path': '/dev/dm-7', 'multipath_id': '3300000006af0b8f0'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:08.183556 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.698s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:08.183556 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:08.187503 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'flavor' on Instance uuid c3e4ef2d-c122-479f-9d8c-af3a8725cb22 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:08.198579 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:08.199122 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:08.201525 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:08.201525 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:08.202339 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:08.203995 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:08.204176 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.219848 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:08.219848 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:08.227074 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:08.227074 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927] added Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:08.234891 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:08.235231 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:08.235231 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:08.235434 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927] added Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:08.243830 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:08.244067 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:08.244564 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:08.244564 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:08.266863 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.391013 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.396472 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.411114 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.412957 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.440063 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.440694 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.448985 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c84c7127-8439-4079-8097-6cb59ef14d32 req-f9a07370-9e88-43e4-b457-e284f25e03c0 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:08.449204 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c84c7127-8439-4079-8097-6cb59ef14d32 req-f9a07370-9e88-43e4-b457-e284f25e03c0 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:08.451821 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c84c7127-8439-4079-8097-6cb59ef14d32 req-f9a07370-9e88-43e4-b457-e284f25e03c0 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:08.453529 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c84c7127-8439-4079-8097-6cb59ef14d32 req-f9a07370-9e88-43e4-b457-e284f25e03c0 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:08.453866 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c84c7127-8439-4079-8097-6cb59ef14d32 req-f9a07370-9e88-43e4-b457-e284f25e03c0 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:08.453866 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-c84c7127-8439-4079-8097-6cb59ef14d32 req-f9a07370-9e88-43e4-b457-e284f25e03c0 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state active and task_state resize_finish. Jul 03 04:19:08.692746 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Attempting to attach volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] attach device xml: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: Jul 03 04:19:08.693840 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:19:08.702414 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.708734 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:08.859567 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000371934999975565 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.859696 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.859900 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.0003554410000106145 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.859900 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.00026255099987793074 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.860345 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-59444ace-221f-463a-a938-175bfacfbf78 None None] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:08.861376 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0011847850000776816 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.861604 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-59444ace-221f-463a-a938-175bfacfbf78 None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] VM Stopped (Lifecycle Event) Jul 03 04:19:08.863547 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:08.863758 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.863937 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Stopped (Lifecycle Event) Jul 03 04:19:08.864889 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.120984458000066 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:08.865011 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.120849700999997 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:09.236231 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:09.245690 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:09.257886 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.263290 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 985dc90b-e484-4add-b0d7-c37a5f952ce6 due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:19:09.263542 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:09.263715 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Resumed (Lifecycle Event) Jul 03 04:19:09.265518 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance event wait completed in 0 seconds for {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:09.269369 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.274360 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance running successfully. Jul 03 04:19:09.274360 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Failed to set time: agent not configured {{(pid=98951) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jul 03 04:19:09.274360 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0b5301d8-ab9f-49ee-9051-750d96fa8535 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] finish_migration finished successfully. {{(pid=98951) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12954}} Jul 03 04:19:09.276810 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.284609 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.296335 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.307613 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:09.345309 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.40.100,3260] Jul 03 04:19:09.345309 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.40.100,3260] successful. Jul 03 04:19:09.345309 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.363666 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.372346 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-59444ace-221f-463a-a938-175bfacfbf78 None None] [instance: 29fd1525-8166-4498-b726-4199f68e7deb] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:09.377028 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.50.100,3260] Jul 03 04:19:09.377028 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.50.100,3260] successful. Jul 03 04:19:09.377028 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.378990 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.388105 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.388536 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:09.388812 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:09.388812 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:09.390370 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] HCTL ('19', '-', '-', 0) found on session 23 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:09.390370 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:09.396980 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:09.407287 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching for a device in session 23 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:09.407569 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.420575 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:09.421029 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:09.421456 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:09.422428 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] HCTL ('20', '-', '-', 0) found on session 24 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:09.422528 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:09.442853 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching for a device in session 24 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:09.442853 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:09.460509 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:09.460713 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:09.461409 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No VIF found with MAC fa:16:3e:ee:b5:97, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:09.461753 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Using config drive Jul 03 04:19:09.771475 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:09.773779 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:09.957306 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:09.966913 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:10.103623 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Creating config drive at /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config Jul 03 04:19:10.108454 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdb5sy0os {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:10.151680 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdb5sy0os" returned: 0 in 0.043s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:10.203646 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:10.277110 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] During sync_power_state the instance has a pending task (resize_finish). Skip. Jul 03 04:19:10.277110 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:10.277904 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Started (Lifecycle Event) Jul 03 04:19:10.360791 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:10.363351 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:10.363351 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:10.363351 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No VIF found with MAC fa:16:3e:76:3b:67, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:10.526610 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:10.526850 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:10.527033 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:10.527169 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:10.527290 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:10.529410 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state resized and task_state None. Jul 03 04:19:10.529611 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-plugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:10.529792 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:10.529923 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:10.530261 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:10.530412 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Processing event network-vif-plugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:10.530562 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-plugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:10.530680 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:10.530800 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:10.530912 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:10.531018 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] No waiting events found dispatching network-vif-plugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:10.531130 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-3a177c08-191f-4c41-8394-1f38188f2d01 req-09815e68-8bc9-4c67-bfcb-e38d6cef8316 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received unexpected event network-vif-plugged-af1aae67-b7a7-4adf-928b-f342e6653627 for instance with vm_state building and task_state spawning. Jul 03 04:19:10.531675 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:10.534607 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:19:10.536614 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Instance spawned successfully. Jul 03 04:19:10.536854 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:19:10.640134 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:10.671530 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:10.676976 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:10.770528 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:10.781534 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:10.788206 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:11.014308 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.016314 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.020569 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.026151 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.045285 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:11.045595 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:11.046473 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:11.047231 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:11.047671 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:11.048175 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:11.054732 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cccbe3b0-f2df-42bf-b30a-a8d54a097df6 req-85610414-8587-42db-a038-ab68094343bd service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:11.055849 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cccbe3b0-f2df-42bf-b30a-a8d54a097df6 req-85610414-8587-42db-a038-ab68094343bd service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:11.056077 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cccbe3b0-f2df-42bf-b30a-a8d54a097df6 req-85610414-8587-42db-a038-ab68094343bd service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:11.056304 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cccbe3b0-f2df-42bf-b30a-a8d54a097df6 req-85610414-8587-42db-a038-ab68094343bd service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:11.056501 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cccbe3b0-f2df-42bf-b30a-a8d54a097df6 req-85610414-8587-42db-a038-ab68094343bd service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Processing event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:11.139100 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.163810 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.170841 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.222917 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Found WWN 3300000008b05f575 for multipath device dm-8 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:11.223346 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:11.223556 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== connect_volume: return (6738ms) {'type': 'block', 'scsi_wwn': '3300000008b05f575', 'path': '/dev/dm-8', 'multipath_id': '3300000008b05f575'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:11.223707 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b05f575', 'path': '/dev/dm-8', 'multipath_id': '3300000008b05f575'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:11.290514 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:11.291115 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] VM Started (Lifecycle Event) Jul 03 04:19:11.562025 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Took 9.03 seconds to spawn the instance on the hypervisor. Jul 03 04:19:11.562025 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:11.599910 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:11.602158 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:19:11.603756 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance spawned successfully. Jul 03 04:19:11.604141 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:19:11.728002 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:11.728660 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:11.728660 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:11.729258 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:11.730586 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:11.747031 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:11.747031 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:11.747843 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:11.750366 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:11.750366 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:11.750366 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:11.766235 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:11.766235 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:11.772180 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:11.775221 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:11.775221 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535] added Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:11.781526 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:11.781750 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:11.781885 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:11.782052 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535] added Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:11.784828 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:11.785027 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:11.785343 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:11.785343 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:11.792789 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:11.794480 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:11.820999 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:11.923687 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:11.923982 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:11.924205 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:11.978898 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-59fd1cd5-5528-433d-b52d-c2f7c7828485 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.031s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:12.076529 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Took 16.51 seconds to build instance. Jul 03 04:19:12.109556 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:12.109726 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:12.110024 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:12.111024 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:12.111740 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:12.111957 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:12.298167 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:12.298793 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] VM Paused (Lifecycle Event) Jul 03 04:19:12.413462 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:12.413663 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:12.494159 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Port 48061ba0-95c3-4156-9d02-bbcee76a06e5 binding to destination host np0000004364 is already ACTIVE {{(pid=98951) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}} Jul 03 04:19:12.494159 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:12.494159 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:12.494159 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:12.577804 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aadcf7a9-6977-4845-b4f1-e63116e29089 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.020s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:12.616488 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Took 7.31 seconds to spawn the instance on the hypervisor. Jul 03 04:19:12.616625 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:12.782534 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:12.785782 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:12.796464 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:12.800250 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.803519 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:12.804869 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:12.805035 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] VM Resumed (Lifecycle Event) Jul 03 04:19:12.811641 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.817289 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.840220 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.840929 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.845494 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:12.918799 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'flavor' on Instance uuid e60c0794-599a-4409-8806-ee2697a55a78 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:12.922249 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:12.923657 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.40.100,3260] Jul 03 04:19:12.923657 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.40.100,3260] successful. Jul 03 04:19:12.923657 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.936411 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.50.100,3260] Jul 03 04:19:12.936411 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.50.100,3260] successful. Jul 03 04:19:12.936411 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.941492 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.952383 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.968835 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.969266 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:12.971204 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:12.971425 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:12.973051 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] HCTL ('21', '-', '-', 0) found on session 25 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:12.973202 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.979629 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:12.979979 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:12.980361 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:12.980361 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:12.981569 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] HCTL ('22', '-', '-', 0) found on session 26 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:12.981667 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:13.000495 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching for a device in session 25 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:13.000495 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:13.003662 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:13.006004 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching for a device in session 26 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:13.007576 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:13.124862 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Took 16.34 seconds to build instance. Jul 03 04:19:13.183178 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a8f84cd2-cd05-41b8-ae7a-731e39d13df1 req-3b68b239-ceb1-4dfa-b4f3-2fa53b99dd06 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:13.183414 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a8f84cd2-cd05-41b8-ae7a-731e39d13df1 req-3b68b239-ceb1-4dfa-b4f3-2fa53b99dd06 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:13.183634 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a8f84cd2-cd05-41b8-ae7a-731e39d13df1 req-3b68b239-ceb1-4dfa-b4f3-2fa53b99dd06 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:13.183799 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a8f84cd2-cd05-41b8-ae7a-731e39d13df1 req-3b68b239-ceb1-4dfa-b4f3-2fa53b99dd06 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:13.183969 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a8f84cd2-cd05-41b8-ae7a-731e39d13df1 req-3b68b239-ceb1-4dfa-b4f3-2fa53b99dd06 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:13.184078 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-a8f84cd2-cd05-41b8-ae7a-731e39d13df1 req-3b68b239-ceb1-4dfa-b4f3-2fa53b99dd06 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state None. Jul 03 04:19:13.310261 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:13.315127 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:13.568701 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:13.634646 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.851s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:13.699155 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:13.748230 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:13.796444 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-changed-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:13.796733 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing instance network info cache due to event network-changed-37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:13.796733 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:13.796843 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:13.796960 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing network info cache for port 37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:13.818476 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] During sync_power_state the instance has a pending task (image_snapshot_pending). Skip. Jul 03 04:19:13.818476 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:13.818476 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Started (Lifecycle Event) Jul 03 04:19:13.872262 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:13.927543 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:13.986998 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010818389998803468 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:13.987756 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:13.987937 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:13.988038 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] VM Stopped (Lifecycle Event) Jul 03 04:19:14.084415 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:14.302716 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:14.321780 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:14.324067 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:14.375770 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:14.407286 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:14.490546 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-0bff68ca-03c0-4868-8a67-0fad6353e0ee None None] [instance: 944f22bd-e9ac-4a28-8278-623847d01847] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:14.589496 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] instance snapshotting Jul 03 04:19:14.690899 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Beginning live snapshot process Jul 03 04:19:14.723180 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:14.767524 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Found WWN 3300000006df266b0 for multipath device dm-11 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:14.767938 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:14.768090 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000006df266b0', 'path': '/dev/dm-11', 'multipath_id': '3300000006df266b0'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:14.768271 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006df266b0', 'path': '/dev/dm-11', 'multipath_id': '3300000006df266b0'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:14.830879 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:14.830879 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Paused (Lifecycle Event) Jul 03 04:19:14.884828 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Creating tmpfile /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/tmpgn3ymmbp to verify with other compute node that the instance is on the same shared storage. {{(pid=98951) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10619}} Jul 03 04:19:14.885035 np0000004364 nova-compute[98951]: DEBUG nova.compute.rpcapi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 03 04:19:14.920056 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updated VIF entry in instance network info cache for port 37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:19:14.920492 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:14.962889 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:15.017275 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:15.017494 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:15.017653 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Attaching volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 to /dev/vdb Jul 03 04:19:15.078836 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:15.092306 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:19:15.116507 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:15.150791 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:19:15.151135 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:19:15.160766 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:19:15.162587 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::fc16:3eff:fef2:7159', 'fe80::ac99:1bff:fe34:ea54', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030'] Jul 03 04:19:15.162791 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:19:15.162925 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:19:15.163259 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:15.163982 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updating existing volume attachment record: cd9df1c6-497e-4fe8-be79-4a1c15125c29 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:19:15.274974 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:15.275516 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:15.275754 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:15.276378 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:15.276695 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:15.290457 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:15.290986 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:15.291575 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:15.292289 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:15.293128 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:15.293482 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:15.312767 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:15.312767 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:15.324164 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:15.324164 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7] added Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:15.331215 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:15.331719 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:15.332653 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:15.332874 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:15.333113 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:15.334413 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:15.334529 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Resumed (Lifecycle Event) Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7] added Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:15.343957 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:15.344227 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:15.344227 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0509(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:15.344460 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:15.419097 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:15.425494 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d2b33823-0bb0-4a94-9891-4c4f4169295c req-c22d41d0-431f-40a5-a41f-3a14a3b7b509 service nova] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:15.441052 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:15.446655 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:15.476178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance destroyed successfully. Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'resources' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json -f qcow2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:09Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000004364',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48061ba0-95, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=651701bc-56e0-44c3-adfe-0a0aa7779995) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: INFO os_vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') Jul 03 04:19:16.403728 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json -f qcow2" returned: 0 in 0.093s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json -f qcow2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999545515999898 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.995375233999994 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.995171810000102 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json -f qcow2" returned: 0 in 0.085s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:16.409725 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.423432 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.431509 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:16.495120 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:16.495120 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc6zm__3e/96ad4aa75e6e47758649b4ba5b26783f.delta 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:16.495120 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.40.100,3260] Jul 03 04:19:16.495120 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.40.100,3260] successful. Jul 03 04:19:16.495120 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.511342 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.50.100,3260] Jul 03 04:19:16.511342 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.50.100,3260] successful. Jul 03 04:19:16.511342 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.520150 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.527665 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.546833 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:16.548314 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.256s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:16.548314 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:16.549831 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] HCTL ('23', '-', '-', 0) found on session 27 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:16.549831 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:16.560653 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:16.561816 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc6zm__3e/96ad4aa75e6e47758649b4ba5b26783f.delta 1073741824" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:16.565806 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Quiescing instance not available: QEMU guest agent is not enabled. Jul 03 04:19:16.565806 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] HCTL ('24', '-', '-', 0) found on session 28 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:16.565806 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:16.566401 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching for a device in session 27 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:16.566401 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:16.587668 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Searching for a device in session 28 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:16.587940 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:16.859473 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 03 04:19:16.861291 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 03 04:19:16.906896 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:19:16.907173 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc6zm__3e/96ad4aa75e6e47758649b4ba5b26783f.delta /opt/stack/data/nova/instances/snapshots/tmpc6zm__3e/96ad4aa75e6e47758649b4ba5b26783f {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:17.024748 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc6zm__3e/96ad4aa75e6e47758649b4ba5b26783f.delta /opt/stack/data/nova/instances/snapshots/tmpc6zm__3e/96ad4aa75e6e47758649b4ba5b26783f" returned: 0 in 0.116s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:17.024979 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Snapshot extracted, beginning image upload Jul 03 04:19:17.294004 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:18.050480 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:18.317031 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Found WWN 330000000afa1d5cb for multipath device dm-12 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:18.317677 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:18.317963 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000afa1d5cb', 'path': '/dev/dm-12', 'multipath_id': '330000000afa1d5cb'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:18.318119 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000afa1d5cb', 'path': '/dev/dm-12', 'multipath_id': '330000000afa1d5cb'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:18.318971 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.578s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:18.319456 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:18.334123 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:18.334740 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:18.338737 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:18.339013 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:18.339521 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:18.339772 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:18.355845 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:18.365749 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:18.372687 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:18.385037 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.397161 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:18.398092 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:18.398092 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:18.399342 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] HCTL ('17', '0', '0', 0) found on session 21 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:18.399342 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.411391 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:18.411860 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:18.412204 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:18.412204 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:18.412283 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching for a device in session 21 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:18.412525 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:18.413944 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] HCTL ('18', '0', '0', 0) found on session 22 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:18.414103 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:18.424580 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Searching for a device in session 22 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:18.424798 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:18.828070 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.832760 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.833755 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.833755 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.834619 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.835154 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.835690 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.835690 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.836311 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.836794 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.837021 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.837607 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.838502 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:18.838992 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:18.839200 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:18.839964 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lazy-loading 'pci_devices' on Instance uuid a17998b3-c8a4-48e0-b311-b828734699cc {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:19.341514 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] End _get_guest_xml xml= Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: a17998b3-c8a4-48e0-b311-b828734699cc Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: instance-0000000b Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: tempest-device-tagging-server-938181740 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 2026-07-03 04:19:04 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: True Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: bare Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: tempest-TaggedBootDevicesTest-904864538-project-member Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: tempest-TaggedBootDevicesTest-904864538 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: a17998b3-c8a4-48e0-b311-b828734699cc Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: a17998b3-c8a4-48e0-b311-b828734699cc Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 15755c61-ebdf-447d-8a59-65387db01927 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 4c52c8d5-59be-4011-adb3-f811202cc535 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: 37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: Jul 03 04:19:19.343556 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Preparing to wait for external event network-vif-plugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.349196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.350739 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.350739 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.350739 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.350739 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.351048 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.351412 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.351869 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.353071 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.353354 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1287efa-4195-5598-ade7-0f5b7a851a55', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.354385 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.355366 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.358037 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.361863 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.362179 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap252ba38f-fd, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.362709 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap252ba38f-fd, col_values=(('qos', UUID('ce39388b-7b95-4974-b69e-5614aa6350c6')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.362995 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap252ba38f-fd, col_values=(('external_ids', {'iface-id': '252ba38f-fd86-45a7-bde9-bf8990e3b9d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:68:6c', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.365803 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.373473 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.374754 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') Jul 03 04:19:19.375625 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.375865 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.376430 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.376684 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.376945 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.377179 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.377397 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.378696 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.378877 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4249709-5e74-59c1-b4c6-8afe0825e8bb', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.380544 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.381417 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.388033 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.393880 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.394191 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb1b1e3e-fe, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.394694 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb1b1e3e-fe, col_values=(('qos', UUID('7d448f86-a6a8-4870-a803-cb54bdd491b8')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.394910 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb1b1e3e-fe, col_values=(('external_ids', {'iface-id': 'eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:09:34', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.396308 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.398017 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.410989 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.411864 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') Jul 03 04:19:19.412673 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.412854 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.413432 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.413670 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.414239 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.414662 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.414942 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.416175 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.416487 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a601a519-4fe3-5fc1-96f2-d99262533a84', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.418146 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.418956 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.429244 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.432032 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.432304 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc856fb16-4e, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.432656 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc856fb16-4e, col_values=(('qos', UUID('e5751e19-e3df-46fa-8769-2849be2f4354')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.432794 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc856fb16-4e, col_values=(('external_ids', {'iface-id': 'c856fb16-4e16-4e1f-aee0-2be9422ac0d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:0b:dc', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.434102 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.435638 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.468932 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.469995 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') Jul 03 04:19:19.470807 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.471030 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.471496 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.471673 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.472048 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.472313 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.472529 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.473561 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.473747 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddc975be-7e61-5bf9-b464-012542c55e90', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.474803 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.475423 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.502145 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.504773 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.505068 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc55a7c12-ce, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.505408 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc55a7c12-ce, col_values=(('qos', UUID('32185ab1-ce77-4196-91de-d3a655428823')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.505550 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc55a7c12-ce, col_values=(('external_ids', {'iface-id': 'c55a7c12-cefb-4547-ab80-3fd1eb3a14c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:9f:00', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.506728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.508375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.531924 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.533062 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') Jul 03 04:19:19.534684 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.534684 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.535943 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.536908 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.537156 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.538190 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.538190 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.539563 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.539916 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91d34ca4-7c16-5c9f-ae45-c02d1519c6e1', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.541051 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.542866 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.563317 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.567732 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.568071 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape621f500-6f, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.568548 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape621f500-6f, col_values=(('qos', UUID('46c08e21-c0d2-45ad-bc76-a61d05466180')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.568757 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape621f500-6f, col_values=(('external_ids', {'iface-id': 'e621f500-6f8f-4957-8211-cc80133cca3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:0d:b0', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.570393 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.572220 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.584422 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.585053 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.586249 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.587137 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.587560 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.587817 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.588077 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.588311 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.588505 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 03 04:19:19.588788 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager.update_available_resource {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:19:19.604410 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.605542 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') Jul 03 04:19:19.606452 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.606757 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.607978 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.608856 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.610151 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.610567 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.610975 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.612737 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.613011 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2428726f-e2b3-573a-b7e6-46d09df032dc', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.615354 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.641343 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.645369 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.645672 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap583fc957-b3, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.646181 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap583fc957-b3, col_values=(('qos', UUID('75a608d0-db49-497b-9723-538986d5e43d')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.646318 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap583fc957-b3, col_values=(('external_ids', {'iface-id': '583fc957-b34a-49b7-b85a-d99dce25a38c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:ef:01', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.651047 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.677047 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.678472 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') Jul 03 04:19:19.679392 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:19.679612 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:19.680281 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:19.680842 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:19.681191 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.681472 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.681669 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:19.683266 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.683470 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90890788-d256-56bb-b029-1e46d4b5e4b8', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.686031 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.687010 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.722270 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.725068 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.725265 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf83d6f94-8d, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.725658 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf83d6f94-8d, col_values=(('qos', UUID('d9734ebf-1f9e-4469-9e3b-23a0873c0e6f')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.725801 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf83d6f94-8d, col_values=(('external_ids', {'iface-id': 'f83d6f94-8dc8-4b7b-9ddd-47874b84aa59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:b8:8b', 'vm-uuid': 'a17998b3-c8a4-48e0-b311-b828734699cc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:19.729735 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:19.770907 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:19.771710 np0000004364 nova-compute[98951]: INFO os_vif [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') Jul 03 04:19:19.874112 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e47a8863-352d-4b52-be1c-e51215ff1829 req-6cb1777d-ccda-4f9f-9491-c8a797087d40 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:19.875110 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e47a8863-352d-4b52-be1c-e51215ff1829 req-6cb1777d-ccda-4f9f-9491-c8a797087d40 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:19.875270 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e47a8863-352d-4b52-be1c-e51215ff1829 req-6cb1777d-ccda-4f9f-9491-c8a797087d40 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:19.876109 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e47a8863-352d-4b52-be1c-e51215ff1829 req-6cb1777d-ccda-4f9f-9491-c8a797087d40 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:19.876109 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e47a8863-352d-4b52-be1c-e51215ff1829 req-6cb1777d-ccda-4f9f-9491-c8a797087d40 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:19.876109 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-e47a8863-352d-4b52-be1c-e51215ff1829 req-6cb1777d-ccda-4f9f-9491-c8a797087d40 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state resized and task_state resize_reverting. Jul 03 04:19:19.962695 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:20.098135 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:20.098388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:20.098594 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:20.098735 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:19:20.359446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Found WWN 3300000006af0b8f0 for multipath device dm-7 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:20.360267 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.041s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:20.361313 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] <== connect_volume: return (4619ms) {'type': 'block', 'scsi_wwn': '3300000006af0b8f0', 'path': '/dev/dm-7', 'multipath_id': '3300000006af0b8f0'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:20.361313 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006af0b8f0', 'path': '/dev/dm-7', 'multipath_id': '3300000006af0b8f0'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:20.361506 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.086s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:20.361983 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:19:20.362188 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:19:20.365353 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'flavor' on Instance uuid e60c0794-599a-4409-8806-ee2697a55a78 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:20.377093 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Snapshot image upload complete Jul 03 04:19:20.377372 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3e7fda02-d2cc-460b-bf41-d89a82c2fb47 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Took 5.79 seconds to snapshot the instance on the hypervisor. Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:20.400215 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:19:20.400843 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '20')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:20.403722 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '19')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:20.405656 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Resulting device map defaultdict(. at 0x76c4506d2ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'): ({'sdf'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:19:20.406727 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Removing multipathed devices sdf, sdg {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:19:20.406727 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flush multipath device 3300000000024c8c2 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:19:20.442944 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:20.490903 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:20.552599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:19:20.552599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:19:20.552599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:19:20.564256 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:19:20.564684 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:19:20.577620 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:20.624864 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] Jul 03 04:19:20.624864 np0000004364 nova-compute[98951]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] successful. Jul 03 04:19:20.624864 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:20.662108 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:20.673281 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:20.715273 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] Jul 03 04:19:20.715273 np0000004364 nova-compute[98951]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] successful. Jul 03 04:19:20.715273 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:20.737695 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:20.737919 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:20.738030 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== disconnect_volume: return (4462ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:20.738141 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:19:20.874914 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Attempting to attach volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] attach device xml: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: Jul 03 04:19:20.876166 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:19:21.137083 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.265363 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.265771 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.278850 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:21.297187 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:21.297187 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:21.297632 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] No VIF found with MAC fa:16:3e:16:68:6c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:21.297954 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] No VIF found with MAC fa:16:3e:0c:0d:b0, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:21.300236 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Using config drive Jul 03 04:19:21.369076 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:21.387443 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.396377 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.493702 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.494435 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.592731 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.596785 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:19:21.596962 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:19:21.597187 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-6 (vdc) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:19:21.598939 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.682468 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.683070 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.758950 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.763414 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Periodic task is updating the host stat, it is trying to get disk instance-0000000b, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc/disk.config' Jul 03 04:19:21.765003 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '985dc90b-e484-4add-b0d7-c37a5f952ce6' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '985dc90b-e484-4add-b0d7-c37a5f952ce6' (instance-00000002) Jul 03 04:19:21.767530 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.814248 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:21.863227 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.863664 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.927738 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:21.929633 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:21.948916 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:21.949624 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:19:21.955403 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:19:21.955640 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:21.986312 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-07c68287-1cd2-47c6-b313-378d68921569 req-cf5f9c20-e1f0-4e06-9781-ecdddfc4bb7a service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:21.987987 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-07c68287-1cd2-47c6-b313-378d68921569 req-cf5f9c20-e1f0-4e06-9781-ecdddfc4bb7a service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:21.987987 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-07c68287-1cd2-47c6-b313-378d68921569 req-cf5f9c20-e1f0-4e06-9781-ecdddfc4bb7a service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:21.987987 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-07c68287-1cd2-47c6-b313-378d68921569 req-cf5f9c20-e1f0-4e06-9781-ecdddfc4bb7a service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:21.987987 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-07c68287-1cd2-47c6-b313-378d68921569 req-cf5f9c20-e1f0-4e06-9781-ecdddfc4bb7a service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:21.987987 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-07c68287-1cd2-47c6-b313-378d68921569 req-cf5f9c20-e1f0-4e06-9781-ecdddfc4bb7a service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state resized and task_state resize_reverting. Jul 03 04:19:22.029566 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Creating config drive at /opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc/disk.config Jul 03 04:19:22.037348 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4nrgymdw {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:22.050906 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:22.055563 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:22.089087 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4nrgymdw" returned: 0 in 0.051s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:22.145943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:22.147596 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:19:22.153254 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:22.156261 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:22.189739 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "env LANG=C uptime" returned: 0 in 0.035s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:22.190169 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Hypervisor/Node resource view: name=np0000004364 free_ram=50862MB free_disk=74.41742324829102GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:19:22.190343 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:22.437643 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'migration_context' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:22.540899 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:22.543448 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:22.543448 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:22.543448 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] No VIF found with MAC fa:16:3e:d3:92:48, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:22.598830 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.671057 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.740356 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.874305 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.883490 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.909583 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.931750 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.938888 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.943850 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-84fe2660-1194-4fbb-9e4f-01e216d0db48 req-cce3b685-909f-4dab-84d5-ba5219e1d3f0 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:22.944071 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-84fe2660-1194-4fbb-9e4f-01e216d0db48 req-cce3b685-909f-4dab-84d5-ba5219e1d3f0 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:22.944472 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-84fe2660-1194-4fbb-9e4f-01e216d0db48 req-cce3b685-909f-4dab-84d5-ba5219e1d3f0 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:22.944472 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-84fe2660-1194-4fbb-9e4f-01e216d0db48 req-cce3b685-909f-4dab-84d5-ba5219e1d3f0 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:22.944766 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-84fe2660-1194-4fbb-9e4f-01e216d0db48 req-cce3b685-909f-4dab-84d5-ba5219e1d3f0 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:22.948125 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Object Instance<985dc90b-e484-4add-b0d7-c37a5f952ce6> lazy-loaded attributes: resources,migration_context {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:19:22.992393 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:22.996253 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.042711 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.069668 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.088004 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.093047 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.133966 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.152177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.200924 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.255352 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.326713 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.332025 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.352786 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:23.352962 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:23.393207 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.428865 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.435688 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.458403 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d6757023-f829-48bf-b3e0-baa48886d812 req-379feb6d-0d1c-4f26-b90b-996fea87b7c0 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:23.458943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d6757023-f829-48bf-b3e0-baa48886d812 req-379feb6d-0d1c-4f26-b90b-996fea87b7c0 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:23.458943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d6757023-f829-48bf-b3e0-baa48886d812 req-379feb6d-0d1c-4f26-b90b-996fea87b7c0 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:23.458943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d6757023-f829-48bf-b3e0-baa48886d812 req-379feb6d-0d1c-4f26-b90b-996fea87b7c0 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:23.459068 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d6757023-f829-48bf-b3e0-baa48886d812 req-379feb6d-0d1c-4f26-b90b-996fea87b7c0 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:23.517527 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.671300 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.682843 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.682843 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.704037 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.779149 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:23.779454 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:23.858812 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:19:23.963810 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:23.965711 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.064296 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:24.064497 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:24.064671 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:24.064780 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:24.064914 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:24.065033 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:24.065190 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:24.065412 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:24.065412 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:24.065503 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No event matching network-vif-plugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 in dict_keys([('network-vif-plugged', 'c55a7c12-cefb-4547-ab80-3fd1eb3a14c4'), ('network-vif-plugged', 'e621f500-6f8f-4957-8211-cc80133cca3f'), ('network-vif-plugged', '583fc957-b34a-49b7-b85a-d99dce25a38c'), ('network-vif-plugged', 'f83d6f94-8dc8-4b7b-9ddd-47874b84aa59')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:19:24.065606 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 for instance with vm_state building and task_state spawning. Jul 03 04:19:24.065845 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:24.065845 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:24.065963 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:24.066048 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:24.066128 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-44447106-eff0-40a3-8ded-098294b937c2 req-0021510f-f24c-4007-bc5c-c41d32c35c59 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:24.131598 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-e502-4a0d-afd3-99f8a595f845 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.113s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:24.161027 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.162381 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.283036 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:24.370282 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.373029 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.440887 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:24.511677 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:24.513396 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] VM Started (Lifecycle Event) Jul 03 04:19:24.732286 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.753821 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.761628 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.768098 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.798506 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:24.968355 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:25.015058 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:25.018223 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-5e651200-c699-46c0-a1e9-4e9215aab6b5 req-04410695-d177-447a-b475-2474dce9a4c5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:25.018477 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5e651200-c699-46c0-a1e9-4e9215aab6b5 req-04410695-d177-447a-b475-2474dce9a4c5 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:25.018656 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5e651200-c699-46c0-a1e9-4e9215aab6b5 req-04410695-d177-447a-b475-2474dce9a4c5 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:25.018788 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-5e651200-c699-46c0-a1e9-4e9215aab6b5 req-04410695-d177-447a-b475-2474dce9a4c5 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:25.018920 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-5e651200-c699-46c0-a1e9-4e9215aab6b5 req-04410695-d177-447a-b475-2474dce9a4c5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No event matching network-vif-plugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 in dict_keys([('network-vif-plugged', 'e621f500-6f8f-4957-8211-cc80133cca3f'), ('network-vif-plugged', '583fc957-b34a-49b7-b85a-d99dce25a38c'), ('network-vif-plugged', 'f83d6f94-8dc8-4b7b-9ddd-47874b84aa59')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:19:25.019057 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-5e651200-c699-46c0-a1e9-4e9215aab6b5 req-04410695-d177-447a-b475-2474dce9a4c5 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 for instance with vm_state building and task_state spawning. Jul 03 04:19:25.022927 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:25.023094 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] VM Paused (Lifecycle Event) Jul 03 04:19:25.048208 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:25.049997 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:25.160479 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:25.302410 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.373s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:25.303143 np0000004364 nova-compute[98951]: DEBUG nova.compute.rpcapi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98951) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jul 03 04:19:25.309551 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.112s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:25.527522 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:25.533359 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:25.539821 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:25.540087 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:25.542771 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:25.543005 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:25.543907 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No event matching network-vif-plugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac in dict_keys([('network-vif-plugged', 'e621f500-6f8f-4957-8211-cc80133cca3f'), ('network-vif-plugged', '583fc957-b34a-49b7-b85a-d99dce25a38c'), ('network-vif-plugged', 'f83d6f94-8dc8-4b7b-9ddd-47874b84aa59')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:19:25.543907 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac for instance with vm_state building and task_state spawning. Jul 03 04:19:25.543907 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:25.543907 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:25.543907 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:25.544282 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:25.544282 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:25.544422 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:25.548976 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:25.549541 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:25.549678 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:25.549900 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No event matching network-vif-plugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 in dict_keys([('network-vif-plugged', 'e621f500-6f8f-4957-8211-cc80133cca3f'), ('network-vif-plugged', '583fc957-b34a-49b7-b85a-d99dce25a38c')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:19:25.550074 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-d460b97e-9c74-48c2-9a68-b880838ab780 req-e6c4929d-8b99-41b8-98c8-7a4913664da1 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 for instance with vm_state building and task_state spawning. Jul 03 04:19:25.877229 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:25.877793 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:26.034998 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:19:26.129489 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:26.129662 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:26.129856 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:26.129989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:26.130114 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No event matching network-vif-plugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 in dict_keys([('network-vif-plugged', 'e621f500-6f8f-4957-8211-cc80133cca3f'), ('network-vif-plugged', '583fc957-b34a-49b7-b85a-d99dce25a38c')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:19:26.130229 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 for instance with vm_state building and task_state spawning. Jul 03 04:19:26.130366 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:26.130540 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:26.130735 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:26.130780 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:26.130865 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:26.131015 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:26.131168 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:26.131285 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:26.131484 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:26.131597 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No event matching network-vif-plugged-e621f500-6f8f-4957-8211-cc80133cca3f in dict_keys([('network-vif-plugged', '583fc957-b34a-49b7-b85a-d99dce25a38c')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:19:26.131718 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-e621f500-6f8f-4957-8211-cc80133cca3f for instance with vm_state building and task_state spawning. Jul 03 04:19:26.131809 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:26.131919 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:26.132024 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:26.132127 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:26.132223 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Processing event network-vif-plugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:26.132339 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-plugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:26.132459 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:26.132574 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:26.132736 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:26.132892 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-plugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:26.133001 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-7322685a-16ee-489d-9291-413a2250e5b1 req-274639db-12e0-4c08-80d4-c13903781394 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received unexpected event network-vif-plugged-583fc957-b34a-49b7-b85a-d99dce25a38c for instance with vm_state building and task_state spawning. Jul 03 04:19:26.134139 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:26.137156 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:26.137375 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] VM Resumed (Lifecycle Event) Jul 03 04:19:26.138806 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:19:26.140445 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance spawned successfully. Jul 03 04:19:26.140834 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:19:26.381086 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Detaching volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:26.429828 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b5ee81e7-eef9-4b72-a375-30801621eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.430400 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.430568 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance e60c0794-599a-4409-8806-ee2697a55a78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.431384 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 5920b3d1-e894-469e-a7f1-add334ef4da8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.431384 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance fab3fe2f-7444-4177-a9ff-0e9b068efe7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.431384 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance a17998b3-c8a4-48e0-b311-b828734699cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.449034 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Attempting to driver detach volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 from mountpoint /dev/vdb Jul 03 04:19:26.452745 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Found disk vdb by alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:19:26.454143 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Found disk vdb by alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:19:26.454235 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Attempting to detach device vdb from instance e60c0794-599a-4409-8806-ee2697a55a78 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] detach device xml: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]:
Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: Jul 03 04:19:26.454714 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:19:26.463629 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully detached device vdb from instance e60c0794-599a-4409-8806-ee2697a55a78 from the persistent domain config. Jul 03 04:19:26.463808 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] (1/8): Attempting to detach device vdb with device alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 from instance e60c0794-599a-4409-8806-ee2697a55a78 from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] detach device xml: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]:
Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: Jul 03 04:19:26.464076 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:19:26.639913 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:26.641832 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:26.649880 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:26.650377 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:26.651181 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:26.651782 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:26.652978 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:26.653600 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:26.924830 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Swapping old allocation on dict_keys(['1a5251c8-01ca-4243-8d62-6cfdc308a824']) held by migration dc66aa5d-f0f5-438a-a414-c780ef0478b1 for instance Jul 03 04:19:26.933413 np0000004364 nova-compute[98951]: INFO nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance dc66aa5d-f0f5-438a-a414-c780ef0478b1 has allocations against this compute host but is not found in the database. Jul 03 04:19:26.935176 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 985dc90b-e484-4add-b0d7-c37a5f952ce6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.935295 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c44b3de1-d811-402b-9852-c5bb063fdcb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:26.935512 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 8797c544-317e-4ae4-9a84-512976e3225f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:19:27.064874 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Overwriting current allocation {'allocations': {'1a5251c8-01ca-4243-8d62-6cfdc308a824': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 18}}, 'project_id': 'a71449bab216465bb9a55183718ff364', 'user_id': '910e8830eace40529a20e5efded682cf', 'consumer_generation': 1} on consumer 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2035}} Jul 03 04:19:27.105477 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:27.110861 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 for instance e60c0794-599a-4409-8806-ee2697a55a78 {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:19:27.146250 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:19:27.148376 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-7411087b-b4c2-4e18-a515-ade2f472c1f7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:19:27.151570 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully detached device vdb from instance e60c0794-599a-4409-8806-ee2697a55a78 from the live domain config. Jul 03 04:19:27.167971 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Took 32.09 seconds to spawn the instance on the hypervisor. Jul 03 04:19:27.168172 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:27.178124 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:27.251407 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:27.251601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquired lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:27.251814 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:27.440570 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 77cf1107-c221-4469-be55-8d94c590491a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jul 03 04:19:27.440882 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:19:27.441064 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=2304MB phys_disk=95GB used_disk=6GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:19:22 up 27 min, 2 users, load average: 8.20, 4.23, 1.98\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_80f331cd7f014a0eb91a6c479ad14d3f': '3', 'io_workload': '1', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_a71449bab216465bb9a55183718ff364': '1', 'num_proj_1f1828cb9b324d3daf261da0474ab91f': '2', 'num_proj_8018e37ae1254f68bfa475fb7625949c': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_9b71dccbd489492bb2cbdb93a1ba716e': '1', 'num_proj_662ad5b7bca441b387156b61f2272bff': '1'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:19:27.686625 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Took 44.55 seconds to build instance. Jul 03 04:19:27.720381 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Detected multiple connections on this host for volume: 7411087b-b4c2-4e18-a515-ade2f472c1f7, skipping target disconnect. Jul 03 04:19:27.754284 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:28.062771 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:28.063235 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:28.138445 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:28.189096 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4eec3c78-f6f5-47ff-a943-0540f990c07b tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 46.061s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:28.289502 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'flavor' on Instance uuid e60c0794-599a-4409-8806-ee2697a55a78 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:28.323441 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:28.566769 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:28.825537 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Releasing lock "refresh_cache-985dc90b-e484-4add-b0d7-c37a5f952ce6" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:28.826038 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:28.839605 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:19:28.873709 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:28.915674 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:19:28.916112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:19:28.925109 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:19:28.931405 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:febd:9694', 'fe80::fc16:3eff:fe29:2702', 'fe80::e46f:28ff:fecf:2f8c', 'fe80::fc16:3eff:fe02:442', 'fe80::fc16:3eff:fec9:1fc2', 'fe80::fc16:3eff:fe1f:1d0c', 'fe80::fc16:3eff:fea0:18ad', 'fe80::b40f:ff:feed:59be', 'fe80::fc16:3eff:fe54:672', 'fe80::285c:1bff:fe9f:8941', 'fe80::fc16:3eff:fee7:c0dc', 'fe80::fc16:3eff:fef2:7159', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030', 'fe80::fc16:3eff:fe16:686c', 'fe80::fc16:3eff:feaa:934', 'fe80::a06f:54ff:fec3:97c0', 'fe80::fc16:3eff:fe2f:bdc', 'fe80::fc16:3eff:fe37:9f00', 'fe80::fc16:3eff:fe0c:db0', 'fe80::fc16:3eff:fec7:ef01', 'fe80::4c6d:59ff:fe93:ad89', 'fe80::fc16:3eff:fe93:b88b', 'fe80::94b1:80ff:feba:e837'] Jul 03 04:19:28.932747 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:19:28.932747 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:19:28.932747 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:29.080640 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:19:29.081826 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.779s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:29.082554 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.642s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:29.082656 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.13 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:19:29.085153 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:19:29.085294 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Claim successful on node np0000004364 Jul 03 04:19:29.295894 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f2192404-1be8-4e94-825b-0217a1bb1fae tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.418s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:29.307002 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-changed-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:29.307130 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing instance network info cache due to event network-changed-252ba38f-fd86-45a7-bde9-bf8990e3b9d8. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:29.307302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] Acquiring lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:29.307902 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] Acquired lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:29.308131 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Refreshing network info cache for port 252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:29.586624 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "92676c92-4e10-44e8-be59-269fd72a616e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:29.586808 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "92676c92-4e10-44e8-be59-269fd72a616e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:29.733931 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:29.812911 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:29.822114 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:29.822262 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:29.822479 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:29.822598 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:29.822716 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:29.824629 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Terminating instance Jul 03 04:19:29.968786 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.035637 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Starting finish_revert_migration {{(pid=98951) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13004}} Jul 03 04:19:30.047955 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start _get_guest_xml network_info=[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'attachment_id': '16ec2537-c37f-4912-91a7-8cd1998c8758', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '985dc90b-e484-4add-b0d7-c37a5f952ce6', 'attached_at': '2026-07-03T04:19:29.000000', 'detached_at': '', 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'serial': '5eb4de56-65f0-42be-9fa8-65917cfadb53'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:30.049498 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:30.051061 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-722411084', uuid='985dc90b-e484-4add-b0d7-c37a5f952ce6'), owner=OwnerMeta(userid='910e8830eace40529a20e5efded682cf', username='tempest-ServerActionsTestOtherB-1313095942-project-member', projectid='a71449bab216465bb9a55183718ff364', projectname='tempest-ServerActionsTestOtherB-1313095942'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052370.05064) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:30.052089 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:30.052534 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:30.053532 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:30.053804 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:30.054929 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:30.055291 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:30.055515 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:30.055669 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:30.055845 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:30.055990 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:30.056124 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:30.056335 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:30.056571 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:30.056737 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:30.056888 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:30.057064 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:30.057273 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'vcpu_model' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:30.095273 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:19:30.245026 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:30.328795 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:19:30.351084 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:30.353918 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:30.426673 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.472356 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.477815 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.505438 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updated VIF entry in instance network info cache for port 252ba38f-fd86-45a7-bde9-bf8990e3b9d8. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:19:30.506775 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [{"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:30.508710 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.519732 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.564810 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.587114 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.590096 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:30.618544 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.646768 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.657123 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6625c00e-e6bc-46bc-8ba0-ee382e28d42c req-f1dca8ab-321f-42f3-bf03-36a6d2d569b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:30.657403 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6625c00e-e6bc-46bc-8ba0-ee382e28d42c req-f1dca8ab-321f-42f3-bf03-36a6d2d569b2 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:30.660742 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6625c00e-e6bc-46bc-8ba0-ee382e28d42c req-f1dca8ab-321f-42f3-bf03-36a6d2d569b2 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:30.660914 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6625c00e-e6bc-46bc-8ba0-ee382e28d42c req-f1dca8ab-321f-42f3-bf03-36a6d2d569b2 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:30.661083 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6625c00e-e6bc-46bc-8ba0-ee382e28d42c req-f1dca8ab-321f-42f3-bf03-36a6d2d569b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:30.661239 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6625c00e-e6bc-46bc-8ba0-ee382e28d42c req-f1dca8ab-321f-42f3-bf03-36a6d2d569b2 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:30.686363 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:30.689041 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.692696 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.config --force-share --output=json" returned: 0 in 0.103s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:30.693149 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:30.694853 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:30.695171 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.696256 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "/opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:30.698615 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:30.698615 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:30.698615 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:30.699515 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:30.699515 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:30.716786 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:30.717302 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:30.720651 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:30.720833 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:30.721456 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:30.721634 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:30.738867 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.738867 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:30.738867 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:30.740203 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:30.740203 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53] added Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:30.751225 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:30.751595 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:30.751813 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:30.752049 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53] added Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:30.756750 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:30.756951 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:30.757041 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:30.757151 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:30.772373 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.812983 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.834569 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.864408 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Detaching volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:30.882487 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.901566 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.921546 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:30.948618 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Attempting to driver detach volume 7411087b-b4c2-4e18-a515-ade2f472c1f7 from mountpoint /dev/vdb Jul 03 04:19:30.960653 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:30.960786 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:30.964917 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Found disk vdb by alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:19:30.966835 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Found disk vdb by alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:19:30.967009 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Attempting to detach device vdb from instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] detach device xml: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]:
Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: Jul 03 04:19:30.967403 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:19:30.977318 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully detached device vdb from instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 from the persistent domain config. Jul 03 04:19:30.977697 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] (1/8): Attempting to detach device vdb with device alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 from instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] detach device xml: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: 7411087b-b4c2-4e18-a515-ade2f472c1f7 Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]:
Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: Jul 03 04:19:30.977798 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:19:30.982804 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.016438 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2ef79a07-9bf3-402e-9b0b-a734bc2ea282 req-62fc0dcd-6f08-4e7a-8dbb-70ad398ccfde service nova] Releasing lock "refresh_cache-a17998b3-c8a4-48e0-b311-b828734699cc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:31.050635 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999548783000137 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:31.052360 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Instance destroyed successfully. Jul 03 04:19:31.053220 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lazy-loading 'resources' on Instance uuid 5920b3d1-e894-469e-a7f1-add334ef4da8 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:31.344787 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004016830000637128 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:31.345436 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:31.345531 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:31.345742 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.704330122000101 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:31.345986 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Stopped (Lifecycle Event) Jul 03 04:19:31.347003 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.703057197000135 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:31.386785 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:31.388721 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:31.389267 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:31.389267 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:31.392862 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:31.393441 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-990dad4f-21fa-472f-bf2e-4d119a9720ce for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:31.393634 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:31.393878 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:31.394037 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:31.394147 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:31.394257 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-990dad4f-21fa-472f-bf2e-4d119a9720ce {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:31.394391 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4bee8085-e71a-4238-8881-752f59f32fe0 req-8b6d7c79-1d31-47ec-903d-3cd29badd760 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-990dad4f-21fa-472f-bf2e-4d119a9720ce for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:31.464175 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:31.556613 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.556841 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "address": "fa:16:3e:bd:96:94", "network": {"id": "9cb846b9-b51a-4db8-99d4-a50515838947", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-777559122-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe950017-4b", "ovs_interfaceid": "fe950017-4bf0-4122-ac89-ebd512e7c5ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.557623 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.557968 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.559926 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.560396 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe950017-4b, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.561432 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.562220 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.598905 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.600138 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.600463 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=535f2832-a503-4424-90b5-03272076ce3f) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.601065 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.601728 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.635475 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.637503 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:96:94,bridge_name='br-int',has_traffic_filtering=True,id=fe950017-4bf0-4122-ac89-ebd512e7c5ba,network=Network(9cb846b9-b51a-4db8-99d4-a50515838947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe950017-4b') Jul 03 04:19:31.638137 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.638286 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "address": "fa:16:3e:29:27:02", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap990dad4f-21", "ovs_interfaceid": "990dad4f-21fa-472f-bf2e-4d119a9720ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.638920 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.639010 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.639713 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.639908 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap990dad4f-21, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.641034 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.641896 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.668482 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.669843 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.670036 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eacb0604-3a1f-457a-9c8f-fb784a5de5c1) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.670783 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.671375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.694673 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.697265 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:27:02,bridge_name='br-int',has_traffic_filtering=True,id=990dad4f-21fa-472f-bf2e-4d119a9720ce,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990dad4f-21') Jul 03 04:19:31.698064 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.698250 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "362342a9-83a3-4b70-a87b-9f6857c94d27", "address": "fa:16:3e:02:04:42", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap362342a9-83", "ovs_interfaceid": "362342a9-83a3-4b70-a87b-9f6857c94d27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.698796 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.699004 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.699992 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.700173 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap362342a9-83, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.701272 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.701997 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.721980 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.722953 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.723098 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=389e4d0d-e0d1-4685-ad7a-883b7cc122fd) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.723743 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.724043 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.745729 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.748647 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:04:42,bridge_name='br-int',has_traffic_filtering=True,id=362342a9-83a3-4b70-a87b-9f6857c94d27,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap362342a9-83') Jul 03 04:19:31.749397 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.749588 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "address": "fa:16:3e:c9:1f:c2", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c965bb-06", "ovs_interfaceid": "29c965bb-06bd-4c50-a7d8-04a4aca7b4a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.750127 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.750374 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.751499 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.751679 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29c965bb-06, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.752468 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:31.752742 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.753730 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.757703 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:31.767027 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.770291 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.771851 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.773013 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=230ed580-3902-4f8c-a360-dfb2261c5fcf) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:31.773389 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.775976 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.781744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.789368 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.793376 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.796306 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1f:c2,bridge_name='br-int',has_traffic_filtering=True,id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c965bb-06') Jul 03 04:19:31.796306 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.796591 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "19674044-1b8a-481a-8591-21c98341631c", "address": "fa:16:3e:1f:1d:0c", "network": {"id": "31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb", "bridge": "br-int", "label": "tempest-device-tagging-net1-781786921", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19674044-1b", "ovs_interfaceid": "19674044-1b8a-481a-8591-21c98341631c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.796916 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.797172 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.798458 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.798569 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19674044-1b, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.799713 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.800793 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.810947 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.811484 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.812247 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:31.812920 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.813952 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.814170 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ace25ee-e1ed-404f-b12c-3f5e96157f85) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.814785 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.815413 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.826316 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.828973 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=19674044-1b8a-481a-8591-21c98341631c,network=Network(31d21023-4c03-4ca7-a7a6-4ac7ea7cafdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19674044-1b') Jul 03 04:19:31.829747 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.829923 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "8533514e-4a12-45ce-9ce9-6659da1572d7", "address": "fa:16:3e:a0:18:ad", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8533514e-4a", "ovs_interfaceid": "8533514e-4a12-45ce-9ce9-6659da1572d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.830472 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.830713 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.831918 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.832178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8533514e-4a, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.833368 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.834102 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.840481 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.840619 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.840783 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d8d7a07-b709-4b02-bd31-0518075aa0dc) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.841615 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.842061 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.846979 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.848630 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:31.849108 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:18:ad,bridge_name='br-int',has_traffic_filtering=True,id=8533514e-4a12-45ce-9ce9-6659da1572d7,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8533514e-4a') Jul 03 04:19:31.849817 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249100034',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-1249100034',id=8,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjjO/g6VuQJpee5C1B1bV8yMBpdW3+0brdjH0EOiNBlSsMnO09vQ3TFoC9K0SJEkgt9aJgGEEwTpFDwhCtxWDThWhwO9N4c7WhBe/qx5JFKZQJzDaDbktfUSXCvJnTRug==',key_name='tempest-keypair-1248371139',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:42Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8018e37ae1254f68bfa475fb7625949c',ramdisk_id='',reservation_id='r-1vxazls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1654626809',owner_user_name='tempest-TaggedBootDevicesTest_v242-1654626809-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18ba934fdb74408791fccc735ddf0237',uuid=5920b3d1-e894-469e-a7f1-add334ef4da8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:31.850007 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converting VIF {"id": "adede961-4ddb-4591-bc2b-9ee9955e955c", "address": "fa:16:3e:54:06:72", "network": {"id": "0ef4aec3-c186-4311-88fb-bbf5ec7b01f0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1025841181", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8018e37ae1254f68bfa475fb7625949c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapadede961-4d", "ovs_interfaceid": "adede961-4ddb-4591-bc2b-9ee9955e955c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:31.850947 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:31.850947 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:31.851489 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.851734 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadede961-4d, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.853118 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.855922 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.855922 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.855922 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.855922 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=680f1e89-eea0-4d27-ae95-16f1c9ab281b) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:31.856175 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:31.856814 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:31.875280 np0000004364 nova-compute[98951]: INFO os_vif [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:06:72,bridge_name='br-int',has_traffic_filtering=True,id=adede961-4ddb-4591-bc2b-9ee9955e955c,network=Network(0ef4aec3-c186-4311-88fb-bbf5ec7b01f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadede961-4d') Jul 03 04:19:31.878806 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:19:31.879205 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:31.879424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:31.892867 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] Jul 03 04:19:31.892867 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] successful. Jul 03 04:19:31.892867 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.905846 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.910646 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] Jul 03 04:19:31.910646 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] successful. Jul 03 04:19:31.910646 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.924960 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.931239 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:31.931815 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:31.932316 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:31.935750 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:31.935750 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:31.951097 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:31.951097 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:31.957022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:31.970743 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.889s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:31.972146 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.285s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:31.973370 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:19:31.976447 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:31.976447 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:31.978887 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:19:31.979160 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Claim successful on node np0000004364 Jul 03 04:19:32.481860 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:32.482153 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:32.482537 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:32.484748 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:32.558378 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8737117-caeb-48db-b4a4-440c7e2aa48f req-b606b674-3e71-4ebd-9c33-4a61c8875b36 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.558815 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8737117-caeb-48db-b4a4-440c7e2aa48f req-b606b674-3e71-4ebd-9c33-4a61c8875b36 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.558965 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8737117-caeb-48db-b4a4-440c7e2aa48f req-b606b674-3e71-4ebd-9c33-4a61c8875b36 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.559071 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8737117-caeb-48db-b4a4-440c7e2aa48f req-b606b674-3e71-4ebd-9c33-4a61c8875b36 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.559185 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8737117-caeb-48db-b4a4-440c7e2aa48f req-b606b674-3e71-4ebd-9c33-4a61c8875b36 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.559593 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8737117-caeb-48db-b4a4-440c7e2aa48f req-b606b674-3e71-4ebd-9c33-4a61c8875b36 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-19674044-1b8a-481a-8591-21c98341631c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.583758 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4937ea515754406fa0fc0d376433084d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f331cd7f014a0eb91a6c479ad14d3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:32.722945 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:32.727818 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.728995 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.729202 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.729798 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.730242 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.730242 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-fe950017-4bf0-4122-ac89-ebd512e7c5ba for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.730511 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.730511 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.730871 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.730871 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.730961 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.731092 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.731779 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.731779 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.731935 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.732060 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.732188 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.732370 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-362342a9-83a3-4b70-a87b-9f6857c94d27 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.732618 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.733066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.733066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.733066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.733297 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.733297 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.733416 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.733615 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.733615 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.733807 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.733807 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.733885 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.734110 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.734110 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.734199 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.734241 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.734343 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.734452 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.734550 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:32.734802 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:32.734802 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:32.735185 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:32.735185 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:32.735185 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6a91a2f3-d092-4b8a-9b99-ee0c103b4f2a req-9db6489d-843f-4814-bb46-d2be565d3475 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-adede961-4ddb-4591-bc2b-9ee9955e955c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:32.975782 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Successfully created port: 41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:19:32.991017 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:19:33.144651 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:33.446417 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-7411087b-b4c2-4e18-a515-ade2f472c1f7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:19:33.447452 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7411087b-b4c2-4e18-a515-ade2f472c1f7 for instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:19:33.453568 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully detached device vdb from instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 from the live domain config. Jul 03 04:19:33.498283 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:19:33.508535 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:19:33.508742 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:33.508826 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:33.589092 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:33.589305 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:33.626038 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Successfully updated port: 41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:19:33.737159 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Found WWN 3300000000024c8c2 for multipath device dm-4 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:33.737461 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:33.737686 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000000024c8c2', 'path': '/dev/dm-4', 'multipath_id': '3300000000024c8c2'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:33.737948 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000024c8c2', 'path': '/dev/dm-4', 'multipath_id': '3300000000024c8c2'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:33.738298 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.859s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:33.738648 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dac5ac5-7275-4620-ba08-d3ff61711cf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:19:33.738772 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:33.773023 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:19:33.773816 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '6')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:33.776840 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9', '5')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:33.776840 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Resulting device map defaultdict(. at 0x76c450442520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'): ({'sdd'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:19:33.777209 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Removing multipathed devices sdd, sde {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:19:33.777342 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Flush multipath device 3300000007e971642 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:19:33.830594 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:33.884098 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:33.934772 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:19:33.934972 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:19:33.936390 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:19:33.948312 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:19:33.948584 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:19:33.959761 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.003437 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Booting with volume-backed-image 60fe5a74-ce6e-4c15-8d86-83089993b0d3 at /dev/vda Jul 03 04:19:34.006583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.40.100,3260] Jul 03 04:19:34.006583 np0000004364 nova-compute[98951]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.40.100,3260] successful. Jul 03 04:19:34.006583 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.031040 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.042962 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.092195 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:34.097417 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.50.100,3260] Jul 03 04:19:34.097417 np0000004364 nova-compute[98951]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-7dac5ac5-7275-4620-ba08-d3ff61711cf9, portal: 192.168.50.100,3260] successful. Jul 03 04:19:34.097417 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.123443 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.123654 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:34.123768 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== disconnect_volume: return (2244ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:34.123892 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:19:34.124460 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.615s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:34.125195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7411087b-b4c2-4e18-a515-ade2f472c1f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:19:34.125604 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:19:34.125947 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:19:34.126217 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:34.126393 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:34.127768 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:34.128065 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:34.128065 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.164578 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:19:34.165176 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '21')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:34.166475 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7', '22')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:34.169044 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Resulting device map defaultdict(. at 0x76c4305f2de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'): ({'sdm'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:19:34.169044 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Removing multipathed devices sdm, sdl {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:19:34.169255 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Flush multipath device 3300000006af0b8f0 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:19:34.216090 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:34.242661 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:09Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004364',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:34.242863 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:34.243299 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] End _get_guest_xml xml= Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: instance-00000002 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-server-722411084 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 2026-07-03 04:19:30 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: True Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: bare Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: ide Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: pc Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-1313095942-project-member Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: tempest-ServerActionsTestOtherB-1313095942 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: 5eb4de56-65f0-42be-9fa8-65917cfadb53 Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: Jul 03 04:19:34.244731 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Preparing to wait for external event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:09Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000004364',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.246989 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:34.247454 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:34.247850 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.247977 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc1a688e-06fd-5b6f-bede-3ec958e4e0bf', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:34.248667 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.249812 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:34.250225 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.251903 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.252024 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48061ba0-95, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:34.252282 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48061ba0-95, col_values=(('qos', UUID('708fc563-46f6-45bc-8d3f-e43bb4f45b23')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:34.252441 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48061ba0-95, col_values=(('external_ids', {'iface-id': '48061ba0-95c3-4156-9d02-bbcee76a06e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:5c:89', 'vm-uuid': '985dc90b-e484-4add-b0d7-c37a5f952ce6'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:34.253151 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.254302 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:34.259420 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.259857 np0000004364 nova-compute[98951]: INFO os_vif [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') Jul 03 04:19:34.269393 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:34.327983 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:19:34.328217 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:19:34.329713 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:19:34.342575 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:19:34.342738 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:19:34.354857 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.400489 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.40.100,3260] Jul 03 04:19:34.400489 np0000004364 nova-compute[98951]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.40.100,3260] successful. Jul 03 04:19:34.400489 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.425904 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.438884 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.485711 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.50.100,3260] Jul 03 04:19:34.485711 np0000004364 nova-compute[98951]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-7411087b-b4c2-4e18-a515-ade2f472c1f7, portal: 192.168.50.100,3260] successful. Jul 03 04:19:34.485711 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.509163 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.509559 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:34.509925 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] <== disconnect_volume: return (1001ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:34.510123 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:19:34.512541 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.386s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:34.512928 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3124766-0a3c-47a2-843c-c0bee03dfe51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:19:34.513132 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.549107 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51 (non-flash) Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:34.549695 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:19:34.550112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '9')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:34.551457 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51', '10')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:34.552852 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Resulting device map defaultdict(. at 0x76c4305f3100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'): ({'sdi'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:19:34.553079 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Removing multipathed devices sdi, sdh {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:19:34.553369 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Flush multipath device 330000000df9d3654 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:19:34.599778 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.628s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:34.599778 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:19:34.604601 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:34.634039 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:34.634672 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:34.635086 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:34.635086 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:34.635086 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:34.635346 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-19674044-1b8a-481a-8591-21c98341631c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:34.635444 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:34.635593 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:34.635722 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:34.635841 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:34.635988 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:34.636141 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-8533514e-4a12-45ce-9ce9-6659da1572d7 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:34.636304 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:34.636520 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Acquiring lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:34.636739 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:34.637570 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:34.637829 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] No waiting events found dispatching network-vif-unplugged-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:34.637993 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-unplugged-8533514e-4a12-45ce-9ce9-6659da1572d7 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:34.638155 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-changed-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:34.638491 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Refreshing instance network info cache due to event network-changed-41beed31-04a2-4b95-9152-d62601cbe2fd. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:34.638668 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Acquiring lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:34.668145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:34.711249 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:34.730798 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:19:34.731004 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:19:34.733932 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:19:34.746979 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:19:34.747199 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:19:34.750810 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.762562 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.781625 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.817237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.40.100,3260] Jul 03 04:19:34.817237 np0000004364 nova-compute[98951]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.40.100,3260] successful. Jul 03 04:19:34.817237 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.842145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.856598 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.885425 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.905403 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.50.100,3260] Jul 03 04:19:34.905403 np0000004364 nova-compute[98951]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-f3124766-0a3c-47a2-843c-c0bee03dfe51, portal: 192.168.50.100,3260] successful. Jul 03 04:19:34.905403 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.931807 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:34.931807 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:34.932205 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== disconnect_volume: return (805ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:34.932205 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:19:34.937281 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:19:34.937977 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:34.937977 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:34.938531 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:34.938631 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '24d7b018-a8b7-4003-acf0-f8215c1668bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:19:34.938732 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:19:34.942901 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:34.970622 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.974971 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:34.975229 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:34.977446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:19:34.977446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '11')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:34.977446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb', '12')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:34.977446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Resulting device map defaultdict(. at 0x76c4305f0040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'): ({'sdk'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:19:34.977696 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Removing multipathed devices sdj, sdk {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:19:34.977811 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Flush multipath device 330000000c0286364 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:19:35.011001 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:35.094641 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'flavor' on Instance uuid c3e4ef2d-c122-479f-9d8c-af3a8725cb22 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:35.096688 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:35.105604 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:35.105604 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:35.106083 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:35.106209 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:35.126313 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:35.140175 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updating instance_info_cache with network_info: [{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:35.145030 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:19:35.145234 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:19:35.145573 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:35.148025 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:35.150426 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:19:35.151343 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:35.153583 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:35.164233 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:19:35.164525 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:19:35.177114 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:35.182885 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:35.205336 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18cf98c1da954ad0bdb32a5854b3ba36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9de1e5af73b486dbece4a569eeaaa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:35.228599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.40.100,3260] Jul 03 04:19:35.228599 np0000004364 nova-compute[98951]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.40.100,3260] successful. Jul 03 04:19:35.228599 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:35.257911 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:35.275145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:35.323231 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.50.100,3260] Jul 03 04:19:35.323231 np0000004364 nova-compute[98951]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-24d7b018-a8b7-4003-acf0-f8215c1668bb, portal: 192.168.50.100,3260] successful. Jul 03 04:19:35.323231 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:35.347190 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:35.347433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:35.347549 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] <== disconnect_volume: return (409ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:35.347655 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:19:35.347888 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Deleting instance files /opt/stack/data/nova/instances/5920b3d1-e894-469e-a7f1-add334ef4da8_del Jul 03 04:19:35.348432 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Deletion of /opt/stack/data/nova/instances/5920b3d1-e894-469e-a7f1-add334ef4da8_del complete Jul 03 04:19:35.613452 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:19:35.643943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:35.643943 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance network_info: |[{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:19:35.646500 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Acquired lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:35.646781 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Refreshing network info cache for port 41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:35.714358 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Successfully created port: 0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:19:35.784848 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:35.784995 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Started (Lifecycle Event) Jul 03 04:19:35.855035 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Took 5.53 seconds to destroy the instance on the hypervisor. Jul 03 04:19:35.855566 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:19:35.855850 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:19:35.855951 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:19:35.856185 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:36.076372 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:36.102248 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-21a65fa4-5327-4e63-b550-269caaa5c6d8 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.751s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:36.117252 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:19:36.154357 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:36.284563 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Successfully updated port: 0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:19:36.290290 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:36.291755 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:36.291916 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Paused (Lifecycle Event) Jul 03 04:19:36.365220 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Received event network-changed-0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:36.365759 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Refreshing instance network info cache due to event network-changed-0bf982fa-6c88-4a41-ae59-0551aace43fc. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:36.365759 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] Acquiring lock "refresh_cache-92676c92-4e10-44e8-be59-269fd72a616e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:36.365759 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] Acquired lock "refresh_cache-92676c92-4e10-44e8-be59-269fd72a616e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:36.365759 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Refreshing network info cache for port 0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:36.538532 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:36.623590 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Booting with volume 6cf220c7-4c01-4116-88c8-380fb83927bf at /dev/vda Jul 03 04:19:36.678603 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:36.692305 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:19:36.695244 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updated VIF entry in instance network info cache for port 41beed31-04a2-4b95-9152-d62601cbe2fd. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:19:36.695653 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updating instance_info_cache with network_info: [{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:36.722184 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:36.748805 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:36.749162 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:36.749369 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:36.749525 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:36.749666 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Processing event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:36.750153 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:36.750386 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:36.750582 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:36.750704 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:36.750940 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:36.751011 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-e8e3c245-30df-4e2e-ac82-726c9b2d9f0d req-6a61ce91-5699-4739-86fa-0566c597278c service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received unexpected event network-vif-plugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with vm_state resized and task_state resize_reverting. Jul 03 04:19:36.751928 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:19:36.752959 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:36.753552 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:19:36.759352 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance running successfully. Jul 03 04:19:36.759949 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] finish_revert_migration finished successfully. {{(pid=98951) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13050}} Jul 03 04:19:36.766211 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:19:36.767968 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fe76:3b67', 'fe80::84ad:efff:fe85:e1c6', 'fe80::fc16:3eff:fed3:9248', 'fe80::fc16:3eff:fee7:c0dc', 'fe80::fc16:3eff:fef2:7159', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030', 'fe80::fc16:3eff:fe16:686c', 'fe80::fc16:3eff:feaa:934', 'fe80::a06f:54ff:fec3:97c0', 'fe80::fc16:3eff:fe2f:bdc', 'fe80::fc16:3eff:fe37:9f00', 'fe80::fc16:3eff:fe0c:db0', 'fe80::fc16:3eff:fec7:ef01', 'fe80::4c6d:59ff:fe93:ad89', 'fe80::fc16:3eff:fe93:b88b', 'fe80::94b1:80ff:feba:e837', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::ac99:1bff:fe34:ea54'] Jul 03 04:19:36.768119 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:19:36.768263 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:19:36.768831 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:36.769044 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Updating existing volume attachment record: 6098aeef-1322-4ef4-8368-4f9ab9cf7c05 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:19:36.791456 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "refresh_cache-92676c92-4e10-44e8-be59-269fd72a616e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:36.797129 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:36.798660 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:36.798784 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Resumed (Lifecycle Event) Jul 03 04:19:36.802657 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:36.802811 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:36.802998 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:36.803146 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:36.803255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:36.810038 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Terminating instance Jul 03 04:19:36.868150 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:36.934388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:36.934625 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:36.934883 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:36.934883 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:36.935018 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:36.940094 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Terminating instance Jul 03 04:19:36.949896 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:37.177095 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:37.211857 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3762294a-486a-4b13-b023-7cec98d7cd55 req-95d7ef62-4d12-4f33-bef1-f56011082f0a service nova] Releasing lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:37.288941 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.301499 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:37.303155 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:37.317539 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:19:37.348198 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.352097 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.376355 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.447355 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:19:37.482903 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.493094 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.508828 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.539938 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.553139 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.570630 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:19:37.578915 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.624939 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.681292 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-aa630fd3-2044-4903-9c7d-07375e8d5a2d req-fd2f3325-fea5-4456-8d5a-e5e532c1b524 service nova] Releasing lock "refresh_cache-92676c92-4e10-44e8-be59-269fd72a616e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:37.681292 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquired lock "refresh_cache-92676c92-4e10-44e8-be59-269fd72a616e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:37.681292 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:37.729734 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6f8e4f06-5a6b-415a-9797-8fb0e6b9e6f3 req-9b527394-d3b2-4800-8358-17acd7d0ade5 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:37.729734 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6f8e4f06-5a6b-415a-9797-8fb0e6b9e6f3 req-9b527394-d3b2-4800-8358-17acd7d0ade5 service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:37.729913 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6f8e4f06-5a6b-415a-9797-8fb0e6b9e6f3 req-9b527394-d3b2-4800-8358-17acd7d0ade5 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:37.730022 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6f8e4f06-5a6b-415a-9797-8fb0e6b9e6f3 req-9b527394-d3b2-4800-8358-17acd7d0ade5 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:37.730529 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6f8e4f06-5a6b-415a-9797-8fb0e6b9e6f3 req-9b527394-d3b2-4800-8358-17acd7d0ade5 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:37.730529 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6f8e4f06-5a6b-415a-9797-8fb0e6b9e6f3 req-9b527394-d3b2-4800-8358-17acd7d0ade5 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:37.805662 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jul 03 04:19:37.811194 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.833647 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99960337199991 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:37.846483 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999345127999959 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:37.860183 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.864545 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Instance destroyed successfully. Jul 03 04:19:37.864545 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Instance destroyed successfully. Jul 03 04:19:37.864545 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'resources' on Instance uuid e60c0794-599a-4409-8806-ee2697a55a78 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:37.872512 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-b867a918-48f6-4343-bf81-8f578bf60db0 tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance to original state: 'active' Jul 03 04:19:37.875564 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lazy-loading 'resources' on Instance uuid c3e4ef2d-c122-479f-9d8c-af3a8725cb22 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:37.884000 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:37.892372 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.032401 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:38.047543 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:19:38.076262 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:38.121416 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:19:38.122027 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:19:38.134132 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:19:38.134132 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fee7:c0dc', 'fe80::fc16:3eff:fef2:7159', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030', 'fe80::fc16:3eff:fe16:686c', 'fe80::fc16:3eff:feaa:934', 'fe80::a06f:54ff:fec3:97c0', 'fe80::fc16:3eff:fe2f:bdc', 'fe80::fc16:3eff:fe37:9f00', 'fe80::fc16:3eff:fe0c:db0', 'fe80::fc16:3eff:fec7:ef01', 'fe80::4c6d:59ff:fe93:ad89', 'fe80::fc16:3eff:fe93:b88b', 'fe80::94b1:80ff:feba:e837', 'fe80::fc16:3eff:fe5e:5c89', 'fe80::ac99:1bff:fe34:ea54', 'fe80::84ad:efff:fe85:e1c6'] Jul 03 04:19:38.134132 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:19:38.134794 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:19:38.135264 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:38.135587 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updating existing volume attachment record: dcba5dc9-e505-4690-bb13-cd1932314124 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:19:38.275478 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.284470 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:38.290105 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.296580 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.328462 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.342481 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.377725 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1625861040-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-testmultiattachvolumeswap-server-1625861040-2',id=7,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtLYQDHUGHqVcQw5upb07xhQqeRAwI70kMEJPLJuvzYpnlESJBJUWrhbqCdnzeHPjcKJKdfGub02LoeHJIY4MKHWJyyCab2VAjwjOv3d+potreXzKWYKeutJitAIRIHAg==',key_name='tempest-keypair-1667604087',keypairs=,launch_index=1,launched_at=2026-07-03T04:18:20Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1f1828cb9b324d3daf261da0474ab91f',ramdisk_id='',reservation_id='r-zachrkr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1858351913',owner_user_name='tempest-TestMultiAttachVolumeSwap-1858351913-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba84ec8d8a40b6ae94d607151b7ae2',uuid=e60c0794-599a-4409-8806-ee2697a55a78,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:38.377998 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converting VIF {"id": "0d57f313-fcff-42ac-a3c3-e0139470d053", "address": "fa:16:3e:d3:92:48", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d57f313-fc", "ovs_interfaceid": "0d57f313-fcff-42ac-a3c3-e0139470d053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:38.378642 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:38.380182 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:38.392470 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1625861040-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-testmultiattachvolumeswap-server-1625861040-1',id=6,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtLYQDHUGHqVcQw5upb07xhQqeRAwI70kMEJPLJuvzYpnlESJBJUWrhbqCdnzeHPjcKJKdfGub02LoeHJIY4MKHWJyyCab2VAjwjOv3d+potreXzKWYKeutJitAIRIHAg==',key_name='tempest-keypair-1667604087',keypairs=,launch_index=0,launched_at=2026-07-03T04:18:07Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1f1828cb9b324d3daf261da0474ab91f',ramdisk_id='',reservation_id='r-zachrkr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1858351913',owner_user_name='tempest-TestMultiAttachVolumeSwap-1858351913-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9ba84ec8d8a40b6ae94d607151b7ae2',uuid=c3e4ef2d-c122-479f-9d8c-af3a8725cb22,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:38.392851 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converting VIF {"id": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "address": "fa:16:3e:76:3b:67", "network": {"id": "cd5eeebb-feda-4cb7-82a4-78960182811d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-82443615-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1f1828cb9b324d3daf261da0474ab91f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1793304b-ef", "ovs_interfaceid": "1793304b-efe8-47f1-8d58-8af8edf0bc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:38.393166 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:38.395265 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:38.415647 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.416641 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1793304b-ef, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:38.427339 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.430691 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:38.434105 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.434686 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.443825 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d57f313-fc, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:38.444301 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.445489 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:38.449341 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.449341 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.449509 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=922136e4-929d-47a1-9779-cc5772d2e3cb) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:38.450467 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.451676 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:38.455136 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.456155 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.456270 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1527ab4-b6b9-4115-b2f7-1c59163fb3a6) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:38.457534 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.459241 np0000004364 nova-compute[98951]: INFO os_vif [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=1793304b-efe8-47f1-8d58-8af8edf0bc6c,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1793304b-ef') Jul 03 04:19:38.459678 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.461659 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Deleting instance files /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22_del Jul 03 04:19:38.462573 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Deletion of /opt/stack/data/nova/instances/c3e4ef2d-c122-479f-9d8c-af3a8725cb22_del complete Jul 03 04:19:38.468262 np0000004364 nova-compute[98951]: INFO os_vif [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:92:48,bridge_name='br-int',has_traffic_filtering=True,id=0d57f313-fcff-42ac-a3c3-e0139470d053,network=Network(cd5eeebb-feda-4cb7-82a4-78960182811d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d57f313-fc') Jul 03 04:19:38.468262 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Deleting instance files /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78_del Jul 03 04:19:38.469181 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Deletion of /opt/stack/data/nova/instances/e60c0794-599a-4409-8806-ee2697a55a78_del complete Jul 03 04:19:38.479651 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.498955 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-fd58c540-01b5-4d6e-a0d3-ea294fe8faa0 req-6c3cd864-bcef-4ae3-adbf-1d167f32a603 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-deleted-19674044-1b8a-481a-8591-21c98341631c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:38.499310 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-fd58c540-01b5-4d6e-a0d3-ea294fe8faa0 req-6c3cd864-bcef-4ae3-adbf-1d167f32a603 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Neutron deleted interface 19674044-1b8a-481a-8591-21c98341631c; detaching it from the instance and deleting it from the info cache Jul 03 04:19:38.504437 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:38.504437 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-fd58c540-01b5-4d6e-a0d3-ea294fe8faa0 req-6c3cd864-bcef-4ae3-adbf-1d167f32a603 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Detach interface failed, port_id=19674044-1b8a-481a-8591-21c98341631c, reason: Instance 5920b3d1-e894-469e-a7f1-add334ef4da8 could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:19:38.552896 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:38.793555 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Updating instance_info_cache with network_info: [{"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:38.822039 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-unplugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:38.823747 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:38.823953 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:38.824083 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:38.824210 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] No waiting events found dispatching network-vif-unplugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:38.824337 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-unplugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:38.824460 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-deleted-29c965bb-06bd-4c50-a7d8-04a4aca7b4a9 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:38.824571 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Neutron deleted interface 29c965bb-06bd-4c50-a7d8-04a4aca7b4a9; detaching it from the instance and deleting it from the info cache Jul 03 04:19:38.826281 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Detach interface failed, port_id=29c965bb-06bd-4c50-a7d8-04a4aca7b4a9, reason: Instance 5920b3d1-e894-469e-a7f1-add334ef4da8 could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:19:38.826462 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-unplugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:38.826594 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] Acquiring lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:38.826727 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:38.826831 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:38.827013 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] No waiting events found dispatching network-vif-unplugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:38.827013 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d20045ba-2d8b-4c31-9f2e-180f63267106 req-16cb8aef-2cbc-487e-bda0-b6ded66fbc7f service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-unplugged-1793304b-efe8-47f1-8d58-8af8edf0bc6c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:38.942475 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Creating image(s) Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Ensure instance console log exists: /opt/stack/data/nova/instances/92676c92-4e10-44e8-be59-269fd72a616e/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:38.953769 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:38.973339 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Took 1.65 seconds to destroy the instance on the hypervisor. Jul 03 04:19:38.973684 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:19:38.973991 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:19:38.973991 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:19:38.974212 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:38.993502 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Took 1.55 seconds to destroy the instance on the hypervisor. Jul 03 04:19:38.995688 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:19:38.996046 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:19:38.996192 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: e60c0794-599a-4409-8806-ee2697a55a78] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:19:38.996483 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:39.143749 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:39.156852 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:39.296001 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Releasing lock "refresh_cache-92676c92-4e10-44e8-be59-269fd72a616e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:39.296518 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Instance network_info: |[{"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:19:39.297132 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Start _get_guest_xml network_info=[{"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6098aeef-1322-4ef4-8368-4f9ab9cf7c05', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '92676c92-4e10-44e8-be59-269fd72a616e', 'attached_at': '', 'detached_at': '', 'volume_id': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'serial': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'multiattach': True}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:39.300147 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:39.301839 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-128181968', uuid='92676c92-4e10-44e8-be59-269fd72a616e'), owner=OwnerMeta(userid='18cf98c1da954ad0bdb32a5854b3ba36', username='tempest-AttachVolumeMultiAttachTest-1445524669-project-member', projectid='f9de1e5af73b486dbece4a569eeaaa68', projectname='tempest-AttachVolumeMultiAttachTest-1445524669'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052379.3012486) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:39.309100 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:39.309757 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:39.312467 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:39.312467 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:39.312467 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:39.313940 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:39.313940 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:39.313940 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:39.313940 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:39.313940 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:39.314248 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:39.314248 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:39.314669 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:39.314669 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:39.315308 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:39.315308 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:39.332850 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:39.333317 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:39.333508 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:39.333858 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:39.334051 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:39.345241 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:39.345829 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:39.346784 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:39.347067 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:39.347706 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:39.347959 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:39.361922 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:39.361922 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:39.364565 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:39.364565 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf] added Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:39.378446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:39.379635 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:39.379635 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf] added Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:39.380689 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:39.380928 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:39.381157 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:39.381318 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:39.831904 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:39.832372 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:39.832531 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:39.832684 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:39.832827 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:39.832991 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:39.833070 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:39.833247 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:39.833388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:39.833556 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:39.833700 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:39.834959 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received unexpected event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with vm_state active and task_state deleting. Jul 03 04:19:39.835152 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:39.835355 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:39.835545 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:39.835730 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:39.836219 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:39.836411 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received unexpected event network-vif-plugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with vm_state active and task_state deleting. Jul 03 04:19:39.836611 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:39.836704 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:39.836964 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:39.837339 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:39.837447 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:39.837844 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:39.837961 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:39.838189 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Acquiring lock "e60c0794-599a-4409-8806-ee2697a55a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:39.838413 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:39.838551 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] Lock "e60c0794-599a-4409-8806-ee2697a55a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:39.838796 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] No waiting events found dispatching network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:39.838995 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-98ef567f-63f6-4308-a462-04a04024ea48 req-3113ad29-f50c-4e3a-8629-bcf128a64e33 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-unplugged-0d57f313-fcff-42ac-a3c3-e0139470d053 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:39.976610 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:40.005859 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:40.266501 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:19:40.266501 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:19:40.266501 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Creating image(s) Jul 03 04:19:40.266501 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:19:40.266501 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Ensure instance console log exists: /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:40.266501 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:40.266928 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:40.267181 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:40.267883 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Start _get_guest_xml network_info=[{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dcba5dc9-e505-4690-bb13-cd1932314124', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '77cf1107-c221-4469-be55-8d94c590491a', 'attached_at': '', 'detached_at': '', 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'serial': '6b296f6f-1224-4410-a9cb-c26d716e7430'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:40.271521 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:40.274593 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:40.276028 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1545140425', uuid='77cf1107-c221-4469-be55-8d94c590491a'), owner=OwnerMeta(userid='4937ea515754406fa0fc0d376433084d', username='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member', projectid='80f331cd7f014a0eb91a6c479ad14d3f', projectname='tempest-ServerBootFromVolumeStableRescueTest-1451627323'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052380.2756877) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:40.277242 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:40.277769 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:40.278900 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:40.279200 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:40.280210 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:40.280896 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:40.281217 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:40.281475 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:40.281811 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:40.282164 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:40.282427 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:40.282756 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:40.282981 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:40.283228 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:40.283486 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:40.283733 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:40.306821 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:19:40.307645 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:40.307645 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:40.378123 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:40.380052 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:40.381667 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:40.393694 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:40.399019 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.406615 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.411879 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.427477 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.428004 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.433051 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.433360 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:40.465427 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:40.465598 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:40.465903 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:40.466224 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:40.466447 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:40.469617 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Terminating instance Jul 03 04:19:40.477912 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf, portal: 192.168.50.100,3260] Jul 03 04:19:40.477912 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf, portal: 192.168.50.100,3260] successful. Jul 03 04:19:40.477912 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.485239 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf, portal: 192.168.40.100,3260] Jul 03 04:19:40.485239 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf, portal: 192.168.40.100,3260] successful. Jul 03 04:19:40.485239 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.490840 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.500757 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:40.510942 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Took 1.51 seconds to deallocate network for instance. Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.517005 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:40.517396 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:40.517676 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:40.518763 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] HCTL ('9', '-', '-', 0) found on session 31 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:40.518870 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.519587 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:40.519987 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:40.520424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:40.520561 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:40.521997 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] HCTL ('10', '-', '-', 0) found on session 32 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:40.522148 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:40.552185 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching for a device in session 31 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:40.552185 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:40.552185 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching for a device in session 32 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:40.552185 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cf220c7-4c01-4116-88c8-380fb83927bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:40.577571 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1d97afa5-99eb-471e-be15-468d5cf12758 req-e5dfcd7c-d780-49d5-b30d-a5ac239564e9 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-deleted-adede961-4ddb-4591-bc2b-9ee9955e955c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:40.578590 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1d97afa5-99eb-471e-be15-468d5cf12758 req-e5dfcd7c-d780-49d5-b30d-a5ac239564e9 service nova] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Received event network-vif-deleted-0d57f313-fcff-42ac-a3c3-e0139470d053 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:40.773806 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Took 4.92 seconds to deallocate network for instance. Jul 03 04:19:40.880074 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Took 1.91 seconds to deallocate network for instance. Jul 03 04:19:40.896845 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-62ea6da1-5b84-4827-bd2c-c4b627824067 req-5c623595-caaa-416c-924e-a683d8132187 service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-deleted-8533514e-4a12-45ce-9ce9-6659da1572d7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:40.896893 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-62ea6da1-5b84-4827-bd2c-c4b627824067 req-5c623595-caaa-416c-924e-a683d8132187 service nova] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Received event network-vif-deleted-1793304b-efe8-47f1-8d58-8af8edf0bc6c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:40.973434 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:19:41.001355 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.007885 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.020624 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:41.020624 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:41.028022 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.032070 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.060829 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.335136 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999661418999949 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:41.336210 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Instance destroyed successfully. Jul 03 04:19:41.336869 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lazy-loading 'resources' on Instance uuid 985dc90b-e484-4add-b0d7-c37a5f952ce6 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:41.348743 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:41.387378 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:41.630503 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:41.630766 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:41.839923 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-722411084',display_name='tempest-ServerActionsTestOtherB-server-722411084',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionstestotherb-server-722411084',id=2,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIsVrZAJCc/Nhnla+87tkZPmX2EdFEA9mgkb0pHdbQgdZIFDlxXINOjSMtBN3UgTFz5sz/8jNCmnVP9D0peyC5hXFZg9GZKfOf6B+syt2ZeYUrr1G4Z6vSdsAR+jSOMjA==',key_name='tempest-keypair-886633405',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:37Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a71449bab216465bb9a55183718ff364',ramdisk_id='',reservation_id='r-xvf7zvxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1313095942',owner_user_name='tempest-ServerActionsTestOtherB-1313095942-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='910e8830eace40529a20e5efded682cf',uuid=985dc90b-e484-4add-b0d7-c37a5f952ce6,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:19:41.840175 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converting VIF {"id": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "address": "fa:16:3e:5e:5c:89", "network": {"id": "ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1803441096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a71449bab216465bb9a55183718ff364", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48061ba0-95", "ovs_interfaceid": "48061ba0-95c3-4156-9d02-bbcee76a06e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:41.840573 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:41.840749 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:19:41.841634 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.841869 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48061ba0-95, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:41.842920 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.843629 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:41.844214 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.845090 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.845259 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=708fc563-46f6-45bc-8d3f-e43bb4f45b23) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:41.845747 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.846223 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:41.846668 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:41.848383 np0000004364 nova-compute[98951]: INFO os_vif [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:89,bridge_name='br-int',has_traffic_filtering=True,id=48061ba0-95c3-4156-9d02-bbcee76a06e5,network=Network(ad6aef6d-2c0b-4051-ae08-5bed48aa1dd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48061ba0-95') Jul 03 04:19:41.849707 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:19:41.850022 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:19:41.850179 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:41.907355 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d4b9c254-7151-4a92-805b-9a7ab548eaf4 req-b4cd1c93-f07f-4ad9-a97a-dd3858cc587e service nova] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Received event network-vif-deleted-fe950017-4bf0-4122-ac89-ebd512e7c5ba {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:42.133231 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:42.363112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found WWN 3300000007ae35caa for multipath device dm-1 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:42.363567 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:42.363740 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000007ae35caa', 'path': '/dev/dm-1', 'multipath_id': '3300000007ae35caa'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:42.363920 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007ae35caa', 'path': '/dev/dm-1', 'multipath_id': '3300000007ae35caa'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:42.364578 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.057s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:42.364578 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:19:42.375523 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:42.376125 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:19:42.376680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:42.377629 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:42.377629 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:42.379969 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:42.390979 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:42.390979 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:42.394516 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:19:42.394516 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430] added Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:42.406060 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:42.406372 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:42.406556 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:42.406752 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430] added Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:19:42.407720 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:42.407972 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:19:42.408088 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:19:42.408255 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:19:42.512108 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Took 1.74 seconds to detach 3 volumes for instance. Jul 03 04:19:42.640759 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.620s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:42.642550 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.254s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:42.717772 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Deleted allocations for instance e60c0794-599a-4409-8806-ee2697a55a78 Jul 03 04:19:42.870153 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-128181968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachvolumemultiattachtest-server-128181968',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-7674skx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:36Z,user_data=None,user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=92676c92-4e10-44e8-be59-269fd72a616e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:42.870445 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:42.870934 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:74:be,bridge_name='br-int',has_traffic_filtering=True,id=0bf982fa-6c88-4a41-ae59-0551aace43fc,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf982fa-6c') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:42.872025 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'pci_devices' on Instance uuid 92676c92-4e10-44e8-be59-269fd72a616e {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:42.959962 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:42.960312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:42.960483 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:42.960595 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:42.960711 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:42.960808 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:42.960903 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:42.961019 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] Acquiring lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:42.961117 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:42.961224 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:42.961337 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] No waiting events found dispatching network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:42.961453 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4eb394a7-6d14-4c0e-9eda-02695d7db04c req-57e03e5f-8971-4cb2-9f5a-6b5302364ac8 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-unplugged-48061ba0-95c3-4156-9d02-bbcee76a06e5 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:19:43.017819 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:43.162296 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:43.162527 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] End _get_guest_xml xml= Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 92676c92-4e10-44e8-be59-269fd72a616e Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: instance-0000000f Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-server-128181968 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 2026-07-03 04:19:39 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: True Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669-project-member Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 92676c92-4e10-44e8-be59-269fd72a616e Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 92676c92-4e10-44e8-be59-269fd72a616e Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: 6cf220c7-4c01-4116-88c8-380fb83927bf Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: Jul 03 04:19:43.378172 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Preparing to wait for external event network-vif-plugged-0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "92676c92-4e10-44e8-be59-269fd72a616e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "92676c92-4e10-44e8-be59-269fd72a616e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "92676c92-4e10-44e8-be59-269fd72a616e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-128181968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachvolumemultiattachtest-server-128181968',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-7674skx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:36Z,user_data=None,user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=92676c92-4e10-44e8-be59-269fd72a616e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "address": "fa:16:3e:a6:74:be", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf982fa-6c", "ovs_interfaceid": "0bf982fa-6c88-4a41-ae59-0551aace43fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:74:be,bridge_name='br-int',has_traffic_filtering=True,id=0bf982fa-6c88-4a41-ae59-0551aace43fc,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf982fa-6c') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:43.380517 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:74:be,bridge_name='br-int',has_traffic_filtering=True,id=0bf982fa-6c88-4a41-ae59-0551aace43fc,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf982fa-6c') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:43.381634 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:43.382445 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:43.382445 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:43.383397 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:43.383682 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfeaffcf-de19-5daf-b752-4dbae11ed07b', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:43.384812 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:43.385718 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:43.390294 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:43.390541 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bf982fa-6c, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:43.390884 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bf982fa-6c, col_values=(('qos', UUID('8e4bd27f-55dc-4d3f-97cd-24cf18632eb4')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:43.391037 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bf982fa-6c, col_values=(('external_ids', {'iface-id': '0bf982fa-6c88-4a41-ae59-0551aace43fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:74:be', 'vm-uuid': '92676c92-4e10-44e8-be59-269fd72a616e'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:43.391923 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:43.393472 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:43.398071 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:43.399605 np0000004364 nova-compute[98951]: INFO os_vif [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:74:be,bridge_name='br-int',has_traffic_filtering=True,id=0bf982fa-6c88-4a41-ae59-0551aace43fc,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf982fa-6c') Jul 03 04:19:43.407579 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:19:43.412661 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:43.423146 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:19:43.430642 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.438414 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.445485 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.461216 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.461715 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.468664 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.469052 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:43.518274 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.50.100,3260] Jul 03 04:19:43.518274 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.50.100,3260] successful. Jul 03 04:19:43.518274 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.526966 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.40.100,3260] Jul 03 04:19:43.526966 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.40.100,3260] successful. Jul 03 04:19:43.526966 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.534770 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.540214 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.556809 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.557177 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:43.557470 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:43.557470 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:43.558860 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('13', '-', '-', 0) found on session 33 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:43.558955 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.564119 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:43.564580 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:43.564942 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:19:43.566020 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('14', '-', '-', 0) found on session 34 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:19:43.566204 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:19:43.578739 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 33 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:43.579100 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:43.588065 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 34 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:19:43.588065 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:19:43.665495 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:43.727568 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fa41c5e1-bafb-449b-94d0-7fd8248ff762 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "e60c0794-599a-4409-8806-ee2697a55a78" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.793s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:44.180897 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.540s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:44.186396 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.163s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:44.243877 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Deleted allocations for instance c3e4ef2d-c122-479f-9d8c-af3a8725cb22 Jul 03 04:19:44.377541 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:19:44.597927 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:44.698740 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:44.698944 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:44.926199 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:44.926409 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:44.926576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:a6:74:be, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:44.926970 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Using config drive Jul 03 04:19:44.977032 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:45.201273 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:45.252601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8cbc6114-96da-425a-ade0-29c45705fdc1 tempest-TestMultiAttachVolumeSwap-1858351913 tempest-TestMultiAttachVolumeSwap-1858351913-project-member] Lock "c3e4ef2d-c122-479f-9d8c-af3a8725cb22" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.449s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:45.394465 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Found WWN 330000000c8fbebcf for multipath device dm-5 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:19:45.394810 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:45.395006 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== connect_volume: return (5088ms) {'type': 'block', 'scsi_wwn': '330000000c8fbebcf', 'path': '/dev/dm-5', 'multipath_id': '330000000c8fbebcf'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:45.395156 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8fbebcf', 'path': '/dev/dm-5', 'multipath_id': '330000000c8fbebcf'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:19:45.396491 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.546s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:19:45.397061 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5eb4de56-65f0-42be-9fa8-65917cfadb53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:19:45.397348 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:19:45.433387 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:45.437843 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:19:45.438350 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:19:45.438734 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '30')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:45.439855 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53', '29')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:19:45.441425 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Resulting device map defaultdict(. at 0x76c4305f1300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'): ({'sdf'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:19:45.441587 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Removing multipathed devices sdf, sdg {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:19:45.441875 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Flush multipath device 3300000000024c8c2 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:19:45.479549 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:45.537058 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:19:45.572102 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Creating config drive at /opt/stack/data/nova/instances/92676c92-4e10-44e8-be59-269fd72a616e/disk.config Jul 03 04:19:45.575770 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92676c92-4e10-44e8-be59-269fd72a616e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4q_sxd8u {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:45.592752 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:19:45.593666 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:19:45.595605 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:19:45.609074 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:19:45.609494 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:19:45.623248 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92676c92-4e10-44e8-be59-269fd72a616e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4q_sxd8u" returned: 0 in 0.047s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:45.623788 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:45.673108 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] Jul 03 04:19:45.673108 np0000004364 nova-compute[98951]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.40.100,3260] successful. Jul 03 04:19:45.673108 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:45.703631 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:45.711394 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.530s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:45.717500 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:45.764140 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] Jul 03 04:19:45.764140 np0000004364 nova-compute[98951]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-5eb4de56-65f0-42be-9fa8-65917cfadb53, portal: 192.168.50.100,3260] successful. Jul 03 04:19:45.764140 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:45.797213 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Deleted allocations for instance 5920b3d1-e894-469e-a7f1-add334ef4da8 Jul 03 04:19:45.799658 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:19:45.800250 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:19:45.800422 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] <== disconnect_volume: return (3950ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:19:45.800576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:19:45.801139 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Deleting instance files /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_del Jul 03 04:19:45.806140 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Deletion of /opt/stack/data/nova/instances/985dc90b-e484-4add-b0d7-c37a5f952ce6_del complete Jul 03 04:19:45.901108 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1545140425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1545140425',id=14,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-o2yuqazi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:34Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=77cf1107-c221-4469-be55-8d94c590491a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:45.901469 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:45.902550 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:45.903518 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'pci_devices' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:46.050721 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006326699999590346 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:46.054008 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:46.054185 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:46.054535 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] VM Stopped (Lifecycle Event) Jul 03 04:19:46.055312 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.777392526999847 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:46.055420 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=6.777272397999923 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:46.103208 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.142297 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.151709 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.239294 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.319607 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Took 5.34 seconds to destroy the instance on the hypervisor. Jul 03 04:19:46.319607 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:19:46.319607 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:19:46.319607 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:19:46.319607 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:46.397236 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] End _get_guest_xml xml= Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: instance-0000000e Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-server-1545140425 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 2026-07-03 04:19:40 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: True Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: bare Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: 6b296f6f-1224-4410-a9cb-c26d716e7430 Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: Jul 03 04:19:46.408895 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:46.411483 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Preparing to wait for external event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:46.411483 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:46.411483 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:46.411483 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:46.412855 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1545140425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1545140425',id=14,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-o2yuqazi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:34Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=77cf1107-c221-4469-be55-8d94c590491a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:46.413500 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:46.414427 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:46.414820 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:46.415302 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.415577 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:46.415898 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:46.417294 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.417721 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff0406a6-c7fc-5238-a4ba-c1cd39e3d4f7', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:46.418583 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.419295 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:46.420729 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.423190 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.423387 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41beed31-04, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:46.423819 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41beed31-04, col_values=(('qos', UUID('005f3b3d-1884-4131-a571-818c4e964802')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:46.424180 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41beed31-04, col_values=(('external_ids', {'iface-id': '41beed31-04a2-4b95-9152-d62601cbe2fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:fa:5d', 'vm-uuid': '77cf1107-c221-4469-be55-8d94c590491a'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:46.425211 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.427731 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:46.428985 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.432340 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.433445 np0000004364 nova-compute[98951]: INFO os_vif [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') Jul 03 04:19:46.442236 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.446872 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.477418 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.478218 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:46.559872 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: 5920b3d1-e894-469e-a7f1-add334ef4da8] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:46.813588 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4a0a3e45-5939-44b8-b2a0-2d041513f832 tempest-TaggedBootDevicesTest_v242-1654626809 tempest-TaggedBootDevicesTest_v242-1654626809-project-member] Lock "5920b3d1-e894-469e-a7f1-add334ef4da8" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 16.991s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:47.011922 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2baa7374-4505-4380-a698-343ebdb346e2 req-e0348ba0-d624-42c0-8383-5f6eb2cf3f98 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Received event network-vif-deleted-48061ba0-95c3-4156-9d02-bbcee76a06e5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:47.013264 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-2baa7374-4505-4380-a698-343ebdb346e2 req-e0348ba0-d624-42c0-8383-5f6eb2cf3f98 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Neutron deleted interface 48061ba0-95c3-4156-9d02-bbcee76a06e5; detaching it from the instance and deleting it from the info cache Jul 03 04:19:47.014292 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2baa7374-4505-4380-a698-343ebdb346e2 req-e0348ba0-d624-42c0-8383-5f6eb2cf3f98 service nova] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Detach interface failed, port_id=48061ba0-95c3-4156-9d02-bbcee76a06e5, reason: Instance 985dc90b-e484-4add-b0d7-c37a5f952ce6 could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:19:47.043942 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:47.044480 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] VM Started (Lifecycle Event) Jul 03 04:19:47.335920 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:47.453432 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:47.547032 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:47.554288 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:47.554461 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] VM Paused (Lifecycle Event) Jul 03 04:19:47.636000 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b70cf9f8-8f3f-491a-90eb-232e87e87562 req-5560798b-feb3-416f-81e2-c10a899e8647 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Received event network-vif-plugged-0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:47.636199 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b70cf9f8-8f3f-491a-90eb-232e87e87562 req-5560798b-feb3-416f-81e2-c10a899e8647 service nova] Acquiring lock "92676c92-4e10-44e8-be59-269fd72a616e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:47.636382 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b70cf9f8-8f3f-491a-90eb-232e87e87562 req-5560798b-feb3-416f-81e2-c10a899e8647 service nova] Lock "92676c92-4e10-44e8-be59-269fd72a616e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:47.636654 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b70cf9f8-8f3f-491a-90eb-232e87e87562 req-5560798b-feb3-416f-81e2-c10a899e8647 service nova] Lock "92676c92-4e10-44e8-be59-269fd72a616e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:47.636854 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b70cf9f8-8f3f-491a-90eb-232e87e87562 req-5560798b-feb3-416f-81e2-c10a899e8647 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Processing event network-vif-plugged-0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:47.637419 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:47.642352 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:19:47.642559 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Instance spawned successfully. Jul 03 04:19:47.642907 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:19:47.961595 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:47.962073 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:19:47.962258 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No VIF found with MAC fa:16:3e:7a:fa:5d, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:19:47.963084 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Using config drive Jul 03 04:19:47.963917 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Took 1.65 seconds to deallocate network for instance. Jul 03 04:19:48.057483 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:48.059854 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:48.059987 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] VM Resumed (Lifecycle Event) Jul 03 04:19:48.154370 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:48.154857 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:48.155165 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:48.155999 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:48.155999 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:48.156321 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:48.474443 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:48.543648 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Took 0.58 seconds to detach 1 volumes for instance. Jul 03 04:19:48.563691 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:48.567671 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:48.665570 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Took 9.72 seconds to spawn the instance on the hypervisor. Jul 03 04:19:48.665570 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:48.707172 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Creating config drive at /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config Jul 03 04:19:48.714716 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp00pnulac {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:48.777220 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp00pnulac" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:49.053847 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:49.054382 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:49.074357 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:19:49.172356 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Took 18.56 seconds to build instance. Jul 03 04:19:49.291624 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:49.331667 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:49.333450 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:49.442083 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:49.503692 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:49.571204 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-11d2582b-7f19-46a1-ac30-16d98740ed9e req-8f46aa1d-4830-45af-ac0b-97d8f60cb2b9 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:49.571465 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-11d2582b-7f19-46a1-ac30-16d98740ed9e req-8f46aa1d-4830-45af-ac0b-97d8f60cb2b9 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:49.571665 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-11d2582b-7f19-46a1-ac30-16d98740ed9e req-8f46aa1d-4830-45af-ac0b-97d8f60cb2b9 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:49.571825 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-11d2582b-7f19-46a1-ac30-16d98740ed9e req-8f46aa1d-4830-45af-ac0b-97d8f60cb2b9 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:49.571962 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-11d2582b-7f19-46a1-ac30-16d98740ed9e req-8f46aa1d-4830-45af-ac0b-97d8f60cb2b9 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Processing event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:19:49.579967 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:49.580199 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:49.632122 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:49.632467 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:49.677509 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "92676c92-4e10-44e8-be59-269fd72a616e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.089s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:49.760770 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8a9179a4-847a-4a51-a578-c8ba206c3a1b req-83181174-27e0-46a8-9d67-b32ee34d8a84 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Received event network-vif-plugged-0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:49.760974 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8a9179a4-847a-4a51-a578-c8ba206c3a1b req-83181174-27e0-46a8-9d67-b32ee34d8a84 service nova] Acquiring lock "92676c92-4e10-44e8-be59-269fd72a616e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:49.761163 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8a9179a4-847a-4a51-a578-c8ba206c3a1b req-83181174-27e0-46a8-9d67-b32ee34d8a84 service nova] Lock "92676c92-4e10-44e8-be59-269fd72a616e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:49.761990 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8a9179a4-847a-4a51-a578-c8ba206c3a1b req-83181174-27e0-46a8-9d67-b32ee34d8a84 service nova] Lock "92676c92-4e10-44e8-be59-269fd72a616e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:49.761990 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8a9179a4-847a-4a51-a578-c8ba206c3a1b req-83181174-27e0-46a8-9d67-b32ee34d8a84 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] No waiting events found dispatching network-vif-plugged-0bf982fa-6c88-4a41-ae59-0551aace43fc {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:49.761990 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8a9179a4-847a-4a51-a578-c8ba206c3a1b req-83181174-27e0-46a8-9d67-b32ee34d8a84 service nova] [instance: 92676c92-4e10-44e8-be59-269fd72a616e] Received unexpected event network-vif-plugged-0bf982fa-6c88-4a41-ae59-0551aace43fc for instance with vm_state active and task_state None. Jul 03 04:19:49.979967 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:50.083566 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:19:50.101595 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:50.138364 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:50.361435 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:50.361848 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:19:50.363172 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Started (Lifecycle Event) Jul 03 04:19:50.367906 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:19:50.370103 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance spawned successfully. Jul 03 04:19:50.370639 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:19:50.653454 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.598s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:50.661585 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:50.661859 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:50.664855 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:19:50.665041 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Claim successful on node np0000004364 Jul 03 04:19:50.725450 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Deleted allocations for instance 985dc90b-e484-4add-b0d7-c37a5f952ce6 Jul 03 04:19:50.811989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:50.812309 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "b991be57-007c-4b9b-9d28-b80d662100a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:50.865495 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:50.870228 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:50.878760 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:50.879114 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:50.879786 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:50.880035 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:50.880392 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:50.883003 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:19:51.319275 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:19:51.372393 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:19:51.373146 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:51.373348 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Paused (Lifecycle Event) Jul 03 04:19:51.387450 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Took 11.12 seconds to spawn the instance on the hypervisor. Jul 03 04:19:51.387687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:51.433717 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:51.638358 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a6320c68-2515-4be7-98ba-83973909c80f req-fb87e8e4-20e7-4cb3-8bb7-8f64ee47e4ab service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:51.638859 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a6320c68-2515-4be7-98ba-83973909c80f req-fb87e8e4-20e7-4cb3-8bb7-8f64ee47e4ab service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:51.639085 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a6320c68-2515-4be7-98ba-83973909c80f req-fb87e8e4-20e7-4cb3-8bb7-8f64ee47e4ab service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:51.639302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a6320c68-2515-4be7-98ba-83973909c80f req-fb87e8e4-20e7-4cb3-8bb7-8f64ee47e4ab service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:51.639523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a6320c68-2515-4be7-98ba-83973909c80f req-fb87e8e4-20e7-4cb3-8bb7-8f64ee47e4ab service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:51.639711 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-a6320c68-2515-4be7-98ba-83973909c80f req-fb87e8e4-20e7-4cb3-8bb7-8f64ee47e4ab service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state active and task_state None. Jul 03 04:19:51.740557 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3fb02fbb-b7de-4e7b-88e6-d5711792c2ee tempest-ServerActionsTestOtherB-1313095942 tempest-ServerActionsTestOtherB-1313095942-project-member] Lock "985dc90b-e484-4add-b0d7-c37a5f952ce6" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 11.275s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:51.834024 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:51.876566 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:51.878910 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:51.879111 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Resumed (Lifecycle Event) Jul 03 04:19:51.884027 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:51.905890 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Took 27.54 seconds to build instance. Jul 03 04:19:52.254723 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:52.255006 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:52.342178 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] instance snapshotting Jul 03 04:19:52.382951 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:52.390318 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:19:52.409399 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.056s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:52.466359 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Beginning live snapshot process Jul 03 04:19:52.586908 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:52.757541 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:52.833751 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010171540000101231 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.833878 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.833994 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.011656964999929187 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.834062 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.011570315999961167 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.834571 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:52.834765 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] VM Stopped (Lifecycle Event) Jul 03 04:19:52.845995 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003118090000953089 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.846083 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.846280 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.4885510730000533 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.846885 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:52.847024 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.4877088890000323 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:52.847152 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] VM Stopped (Lifecycle Event) Jul 03 04:19:53.093034 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:53.093312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:53.267775 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.606s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:53.268188 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:19:53.270531 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.387s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:53.275115 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:19:53.275561 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Claim successful on node np0000004364 Jul 03 04:19:53.338386 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-97730d94-409c-4806-bffa-65c9b40e1121 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: c3e4ef2d-c122-479f-9d8c-af3a8725cb22] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:53.352047 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: e60c0794-599a-4409-8806-ee2697a55a78] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:53.599634 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:19:53.775487 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:53.775741 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:53.776184 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:53.776505 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:53.880138 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af92ec9d358c4fcd997ca5ca9acfe7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82604b4949eb47659d954def4e326795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:53.996590 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json -f qcow2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:54.080848 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:54.081504 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json -f qcow2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:54.186588 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:54.188941 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:54.190666 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Rescuing Jul 03 04:19:54.190666 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:54.190863 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:54.191087 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:54.205009 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:54.207261 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:54.208712 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:54.281892 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:19:54.332853 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.122s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:54.334091 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2zjx_v3k/7efe06fb34b34d419fa4d9fa94002f1e.delta 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:54.390888 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2zjx_v3k/7efe06fb34b34d419fa4d9fa94002f1e.delta 1073741824" returned: 0 in 0.058s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:54.391390 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Quiescing instance not available: QEMU guest agent is not enabled. Jul 03 04:19:54.410934 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Successfully created port: c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:19:54.685013 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 03 04:19:54.710009 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:54.794020 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:19:54.941490 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:54.941490 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:55.105852 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Successfully updated port: c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:19:55.160130 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:55.182252 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-changed-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:55.182641 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Refreshing instance network info cache due to event network-changed-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:19:55.183156 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] Acquiring lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:55.183156 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] Acquired lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:55.183156 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Refreshing network info cache for port c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:19:55.187279 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98951) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jul 03 04:19:55.188765 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Skipping quiescing instance: QEMU guest agent is not enabled. Jul 03 04:19:55.247834 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:19:55.248351 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2zjx_v3k/7efe06fb34b34d419fa4d9fa94002f1e.delta /opt/stack/data/nova/instances/snapshots/tmp2zjx_v3k/7efe06fb34b34d419fa4d9fa94002f1e {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:55.319306 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:55.446921 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:55.497672 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updating instance_info_cache with network_info: [{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:55.572077 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2zjx_v3k/7efe06fb34b34d419fa4d9fa94002f1e.delta /opt/stack/data/nova/instances/snapshots/tmp2zjx_v3k/7efe06fb34b34d419fa4d9fa94002f1e" returned: 0 in 0.324s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:55.576192 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Snapshot extracted, beginning image upload Jul 03 04:19:55.610299 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:55.684937 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:55.761505 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:55.807916 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:19:55.809182 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:19:55.809316 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Creating image(s) Jul 03 04:19:55.810167 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:55.810554 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:55.812212 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:55.813025 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:55.816730 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:55.818025 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:55.907132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.086s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:55.907132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:55.907132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:55.907132 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:55.915596 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:55.916222 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:55.939167 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:55.969419 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.699s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:55.969801 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:19:55.978081 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.771s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:55.982778 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:19:55.982778 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Claim successful on node np0000004364 Jul 03 04:19:56.003576 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:56.008294 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.092s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:56.008294 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:56.099577 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk 1073741824" returned: 0 in 0.091s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:56.099837 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:56.103268 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.196s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:56.103741 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:56.194933 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.091s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:56.195319 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:19:56.196467 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:56.240906 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:56.278168 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:56.278619 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Cannot resize image /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:19:56.278996 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:19:56.279159 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Ensure instance console log exists: /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:56.279553 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:56.279807 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:56.279974 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:56.335474 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005237349998878926 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:56.335822 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:19:56.336242 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:56.337810 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] VM Stopped (Lifecycle Event) Jul 03 04:19:56.435421 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:56.443653 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85e8eebd-d1cf-433e-adc6-fafe95353bf6 req-e62c787d-2d58-4fa5-a72a-06b9ee2e05a6 service nova] Releasing lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:56.445270 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquired lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:56.445527 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:56.482978 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:56.483503 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:56.484551 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:56.484551 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:56.619212 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af92ec9d358c4fcd997ca5ca9acfe7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82604b4949eb47659d954def4e326795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:56.839544 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 985dc90b-e484-4add-b0d7-c37a5f952ce6] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:19:56.987934 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:19:57.067181 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:57.138989 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Successfully created port: 1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:19:57.351219 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:57.491071 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:19:57.548860 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Updating instance_info_cache with network_info: [{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:57.737937 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:57.761091 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:57.775624 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:19:57.775966 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:19:57.920111 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:57.927090 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.002609 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Successfully updated port: 1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:19:58.045691 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a369f0-779b-485b-9238-65811f0fb84a req-b25ba7bc-904c-48cb-8257-10758d759b26 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:19:58.047284 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a369f0-779b-485b-9238-65811f0fb84a req-b25ba7bc-904c-48cb-8257-10758d759b26 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:58.047284 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a369f0-779b-485b-9238-65811f0fb84a req-b25ba7bc-904c-48cb-8257-10758d759b26 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:58.047577 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-69a369f0-779b-485b-9238-65811f0fb84a req-b25ba7bc-904c-48cb-8257-10758d759b26 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:58.047786 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-69a369f0-779b-485b-9238-65811f0fb84a req-b25ba7bc-904c-48cb-8257-10758d759b26 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:19:58.048985 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-69a369f0-779b-485b-9238-65811f0fb84a req-b25ba7bc-904c-48cb-8257-10758d759b26 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state active and task_state rescuing. Jul 03 04:19:58.051402 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Releasing lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:19:58.052519 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance network_info: |[{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:19:58.055225 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Start _get_guest_xml network_info=[{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:19:58.058316 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:19:58.060497 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1126143668', uuid='5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995'), owner=OwnerMeta(userid='af92ec9d358c4fcd997ca5ca9acfe7c3', username='tempest-ServerRescueNegativeTestJSON-764277257-project-member', projectid='82604b4949eb47659d954def4e326795', projectname='tempest-ServerRescueNegativeTestJSON-764277257'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052398.0595307) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:19:58.062168 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999669555000082 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:58.062957 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999017069000047 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:58.062957 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998900706000086 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:19:58.070792 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:19:58.071171 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance destroyed successfully. Jul 03 04:19:58.072288 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:19:58.072776 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'numa_topology' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:58.080477 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:19:58.080477 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:19:58.082822 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:19:58.083007 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:19:58.084160 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:19:58.084429 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:19:58.085645 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:19:58.085645 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:19:58.106405 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1126143668',display_name='tempest-ServerRescueNegativeTestJSON-server-1126143668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-1126143668',id=16,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-mgdznc5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:55Z,user_data=None,user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:19:58.106977 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:58.108010 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2d:83,bridge_name='br-int',has_traffic_filtering=True,id=c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dd3d62-2f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:58.108950 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:58.278877 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:19:58.498575 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:19:58.499420 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:19:58.499635 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Creating image(s) Jul 03 04:19:58.500052 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "/opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:58.500227 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:58.500631 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:58.501122 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:58.503693 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:58.504952 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:58.516855 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:19:58.517207 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquired lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:19:58.517850 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:19:58.564178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.585654 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Attempting a stable device rescue Jul 03 04:19:58.594965 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.089s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:58.595683 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:58.595683 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:58.596081 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:58.599880 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:19:58.600413 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] End _get_guest_xml xml= Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: instance-00000010 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 196608 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-server-1126143668 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 2026-07-03 04:19:58 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 192 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: True Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: bare Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 0 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: virtio Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257-project-member Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: hvm Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 128 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: 1 Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: Jul 03 04:19:58.622862 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:19:58.626538 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Preparing to wait for external event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:19:58.626538 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:58.626538 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:58.626538 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:58.627641 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1126143668',display_name='tempest-ServerRescueNegativeTestJSON-server-1126143668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-1126143668',id=16,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-mgdznc5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:55Z,user_data=None,user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:19:58.627882 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:19:58.629083 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2d:83,bridge_name='br-int',has_traffic_filtering=True,id=c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dd3d62-2f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:19:58.629479 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2d:83,bridge_name='br-int',has_traffic_filtering=True,id=c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dd3d62-2f') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:19:58.632550 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.633093 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:58.633586 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:19:58.637572 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.637881 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf0bbec8-39be-537b-9465-a842c7c67baa', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:58.639092 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.639993 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:58.648358 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.653076 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.653207 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6dd3d62-2f, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:58.653631 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6dd3d62-2f, col_values=(('qos', UUID('d1a720fb-57fd-410c-ae09-73cea63501e3')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:58.653819 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6dd3d62-2f, col_values=(('external_ids', {'iface-id': 'c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:2d:83', 'vm-uuid': '5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:19:58.656809 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.659132 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:19:58.667868 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:19:58.669194 np0000004364 nova-compute[98951]: INFO os_vif [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2d:83,bridge_name='br-int',has_traffic_filtering=True,id=c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dd3d62-2f') Jul 03 04:19:58.700432 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.100s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:58.701015 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:58.765169 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 03 04:19:58.765695 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk 1073741824" returned: 0 in 0.065s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:58.766173 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.171s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:58.766677 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:58.791105 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.815s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:58.792103 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:19:58.799259 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance directory exists: not creating {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 03 04:19:58.799483 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Creating image(s) Jul 03 04:19:58.800560 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "/opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:58.800895 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:58.801528 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:58.801821 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'trusted_certs' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:19:58.878521 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.112s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:58.878950 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:19:58.879213 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:19:58.975376 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:19:58.975818 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Cannot resize image /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:19:58.976213 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:19:58.976398 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Ensure instance console log exists: /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:19:58.976665 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:58.976884 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:58.977063 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:19:59.108031 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:19:59.112894 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Snapshot image upload complete Jul 03 04:19:59.113262 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-21d13738-1b74-4e58-9b63-65be04cdd170 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Took 6.76 seconds to snapshot the instance on the hypervisor. Jul 03 04:19:59.301806 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:19:59.301993 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:19:59.302370 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:59.302615 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:59.308180 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:19:59.313518 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:19:59.314386 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "149d11adba360efb7818629b518ec46783903890" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:19:59.315374 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "149d11adba360efb7818629b518ec46783903890" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:19:59.442927 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18cf98c1da954ad0bdb32a5854b3ba36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9de1e5af73b486dbece4a569eeaaa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:19:59.621450 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Updating instance_info_cache with network_info: [{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:19:59.813996 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:00.039728 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Successfully created port: 19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:00.121041 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-changed-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:00.121041 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Refreshing instance network info cache due to event network-changed-1c4a0dea-a323-4809-9b68-25896065a092. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:00.121041 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] Acquiring lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:00.128312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Releasing lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:00.128312 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance network_info: |[{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:00.128312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] Acquired lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:00.128968 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Refreshing network info cache for port 1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:00.135829 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Start _get_guest_xml network_info=[{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:00.135829 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:00.138113 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-425422393', uuid='b991be57-007c-4b9b-9d28-b80d662100a9'), owner=OwnerMeta(userid='af92ec9d358c4fcd997ca5ca9acfe7c3', username='tempest-ServerRescueNegativeTestJSON-764277257-project-member', projectid='82604b4949eb47659d954def4e326795', projectname='tempest-ServerRescueNegativeTestJSON-764277257'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052400.1368237) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:00.149293 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:00.150224 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:00.152045 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:00.152579 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:00.153947 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:00.153947 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:00.155009 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:00.155009 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:00.156885 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:00.156885 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:00.156885 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:00.157626 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:00.157626 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:00.157626 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:00.157626 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:00.157907 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:00.165370 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.178001 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425422393',display_name='tempest-ServerRescueNegativeTestJSON-server-425422393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-425422393',id=17,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-lvvxz665',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:58Z,user_data=None,user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=b991be57-007c-4b9b-9d28-b80d662100a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:00.178245 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:00.178923 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:99,bridge_name='br-int',has_traffic_filtering=True,id=1c4a0dea-a323-4809-9b68-25896065a092,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4a0dea-a3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:00.179862 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'pci_devices' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:00.198193 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:00.205244 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:00.205726 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.part --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:00.207202 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:00.218214 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:00.218637 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No VIF found with MAC fa:16:3e:92:2d:83, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:00.223024 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Using config drive Jul 03 04:20:00.312313 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.part --force-share --output=json" returned: 0 in 0.106s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:00.312873 np0000004364 nova-compute[98951]: DEBUG nova.virt.images [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] a6bda82b-57c8-49b7-afc3-f1d75e9ce475 was qcow2, converting to raw {{(pid=98951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 03 04:20:00.313546 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:20:00.313892 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.part /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.converted {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:00.327634 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:00.429948 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.part /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.converted" returned: 0 in 0.116s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:00.441077 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.converted --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:00.555997 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890.converted --force-share --output=json" returned: 0 in 0.117s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:00.557113 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "149d11adba360efb7818629b518ec46783903890" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.242s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:00.557579 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:00.563406 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:00.565482 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "149d11adba360efb7818629b518ec46783903890" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:00.566381 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "149d11adba360efb7818629b518ec46783903890" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:00.566873 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:00.572989 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:00.573542 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:00.640771 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:00.675842 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890 --force-share --output=json" returned: 0 in 0.102s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:00.676255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890,backing_fmt=raw /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.rescue {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] End _get_guest_xml xml= Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: b991be57-007c-4b9b-9d28-b80d662100a9 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: instance-00000011 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-server-425422393 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 2026-07-03 04:20:00 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: True Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: bare Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257-project-member Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: b991be57-007c-4b9b-9d28-b80d662100a9 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: b991be57-007c-4b9b-9d28-b80d662100a9 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: Jul 03 04:20:00.700389 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:00.703981 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Preparing to wait for external event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:00.704639 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:00.705228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:00.705228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:00.707189 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425422393',display_name='tempest-ServerRescueNegativeTestJSON-server-425422393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-425422393',id=17,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-lvvxz665',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:58Z,user_data=None,user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=b991be57-007c-4b9b-9d28-b80d662100a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:00.707646 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:00.711619 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:99,bridge_name='br-int',has_traffic_filtering=True,id=1c4a0dea-a323-4809-9b68-25896065a092,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4a0dea-a3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:00.712045 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:99,bridge_name='br-int',has_traffic_filtering=True,id=1c4a0dea-a323-4809-9b68-25896065a092,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4a0dea-a3') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:00.713547 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.714104 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:00.714532 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:00.716794 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.717597 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9670f7c7-4c22-5383-b030-81c402364728', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:00.720504 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:00.732116 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.743314 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:00.749448 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.749906 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c4a0dea-a3, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:00.750357 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c4a0dea-a3, col_values=(('qos', UUID('b09d8593-bf06-447b-be26-fbd81a4cf41a')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:00.750622 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c4a0dea-a3, col_values=(('external_ids', {'iface-id': '1c4a0dea-a323-4809-9b68-25896065a092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:20:99', 'vm-uuid': 'b991be57-007c-4b9b-9d28-b80d662100a9'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:00.752513 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/149d11adba360efb7818629b518ec46783903890,backing_fmt=raw /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.rescue" returned: 0 in 0.076s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:00.753365 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.754268 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "149d11adba360efb7818629b518ec46783903890" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.188s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:00.754638 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'migration_context' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:00.759400 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:00.775553 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:00.778280 np0000004364 nova-compute[98951]: INFO os_vif [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:99,bridge_name='br-int',has_traffic_filtering=True,id=1c4a0dea-a323-4809-9b68-25896065a092,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4a0dea-a3') Jul 03 04:20:01.027131 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Successfully updated port: 19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:01.107599 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:01.117998 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Received event network-changed-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:01.118190 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Refreshing instance network info cache due to event network-changed-19dc47b6-659a-405b-ae05-e44a65ad0894. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:01.118483 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] Acquiring lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:01.118566 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] Acquired lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:01.118681 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Refreshing network info cache for port 19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:01.261647 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:01.262013 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:01.262919 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Start _get_guest_xml network_info=[{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:7a:fa:5d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue={'image_id': 'a6bda82b-57c8-49b7-afc3-f1d75e9ce475', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dcba5dc9-e505-4690-bb13-cd1932314124', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '77cf1107-c221-4469-be55-8d94c590491a', 'attached_at': '', 'detached_at': '', 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'serial': '6b296f6f-1224-4410-a9cb-c26d716e7430'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:01.263138 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'resources' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:01.351360 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:01.352728 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:01.353142 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Creating image(s) Jul 03 04:20:01.360066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "/opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:01.360066 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:01.362013 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:01.362731 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:01.370782 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:01.374512 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:01.415248 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:01.423135 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Creating config drive at /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.config Jul 03 04:20:01.430120 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp__c77isw {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:01.482811 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp__c77isw" returned: 0 in 0.052s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:01.501101 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.127s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:01.501579 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:01.502059 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:01.502677 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:01.514495 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:01.514657 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:01.534461 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:01.544571 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:01.608815 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.094s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:01.609244 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:01.627422 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:01.686833 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk 1073741824" returned: 0 in 0.077s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:01.687520 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.185s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:01.687784 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:01.738581 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:01.738581 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:01.765323 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:01.772212 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:01.772212 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1545140425', uuid='77cf1107-c221-4469-be55-8d94c590491a'), owner=OwnerMeta(userid='4937ea515754406fa0fc0d376433084d', username='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member', projectid='80f331cd7f014a0eb91a6c479ad14d3f', projectname='tempest-ServerBootFromVolumeStableRescueTest-1451627323'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:7a:fa:5d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052401.7714844) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:01.780024 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:01.782178 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:01.784894 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:01.797048 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:01.797048 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:01.797048 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:01.806136 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:01.808938 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:01.808938 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:01.817207 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.129s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:01.821063 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:20:01.825110 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:01.883731 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Updated VIF entry in instance network info cache for port 1c4a0dea-a323-4809-9b68-25896065a092. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:01.884896 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Updating instance_info_cache with network_info: [{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:01.929603 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:01.930377 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Cannot resize image /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:20:01.930616 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:01.930873 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Ensure instance console log exists: /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:01.931365 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:01.931638 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:01.931806 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:02.059710 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:02.090531 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.137421 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.142606 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.237316 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.245491 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'flavor' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:02.322947 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:02.347972 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:02.370559 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:02.370692 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:02.370832 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No VIF found with MAC fa:16:3e:83:20:99, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:02.375068 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Using config drive Jul 03 04:20:02.388415 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] Releasing lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:02.389024 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:02.389985 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:02.389985 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:02.390129 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:02.391402 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:02.392121 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-85bcf0b6-38d1-4506-a83a-cfb885283b4b req-32859266-e101-4d08-a790-126b0eb5585b service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state active and task_state rescuing. Jul 03 04:20:02.455148 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:02.456194 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "/opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:02.456423 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:02.457497 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "/opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:02.458136 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:20:02.458222 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:02.458428 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:02.458915 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:02.459146 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:20:02.477360 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:02.477360 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:02.477360 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:02.478752 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:02.479128 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:02.479128 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:02.501343 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:02.507627 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:02.512368 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:02.517374 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.521953 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.526025 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:02.532357 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:02.552424 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:02.553634 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('13', '0', '0', 0) found on session 33 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:02.553746 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:02.558563 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.560935 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:02.561840 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.087s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:02.564531 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:02.565541 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-95e889b6-2f3b-43b2-8630-a8d722e8bcc2 req-d4a8b7f7-d6b6-4c92-94b3-539be2e266d3 service nova] Releasing lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:02.565541 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] HCTL ('14', '0', '0', 0) found on session 34 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:02.565638 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:02.568053 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquired lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:02.568053 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:02.569059 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 33 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:02.572356 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:02.578336 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Searching for a device in session 34 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:02.578599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:02.586893 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9db548d5-b772-422c-98d9-49d2d2a15a13 req-35431cfc-2638-4a92-9d00-c62f8ed2b9c1 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:02.587072 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9db548d5-b772-422c-98d9-49d2d2a15a13 req-35431cfc-2638-4a92-9d00-c62f8ed2b9c1 service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:02.587244 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9db548d5-b772-422c-98d9-49d2d2a15a13 req-35431cfc-2638-4a92-9d00-c62f8ed2b9c1 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:02.587414 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9db548d5-b772-422c-98d9-49d2d2a15a13 req-35431cfc-2638-4a92-9d00-c62f8ed2b9c1 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:02.587556 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9db548d5-b772-422c-98d9-49d2d2a15a13 req-35431cfc-2638-4a92-9d00-c62f8ed2b9c1 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Processing event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:02.887316 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:03.039379 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:03.040132 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:03.040132 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Started (Lifecycle Event) Jul 03 04:20:03.043715 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:03.047674 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance spawned successfully. Jul 03 04:20:03.048050 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:03.083554 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Creating config drive at /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.config Jul 03 04:20:03.085011 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0_3q95_f {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:03.130008 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0_3q95_f" returned: 0 in 0.044s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:03.179047 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:03.255218 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.517s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:03.370977 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:03.481038 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:20:03.533933 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.539896 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updating instance_info_cache with network_info: [{"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:03.543476 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:03.549391 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:03.563187 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:03.563476 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:03.564306 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:03.564856 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:03.565134 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:03.565539 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:03.631821 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.678088 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.679178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.777316 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.824047 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.831792 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:03.861704 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e38d1cd2-c636-46ea-a9e3-bb0258f9ad82 req-4bc2f08e-3436-4698-aced-a91f79a35489 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:03.862752 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e38d1cd2-c636-46ea-a9e3-bb0258f9ad82 req-4bc2f08e-3436-4698-aced-a91f79a35489 service nova] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:03.862955 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e38d1cd2-c636-46ea-a9e3-bb0258f9ad82 req-4bc2f08e-3436-4698-aced-a91f79a35489 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:03.863089 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e38d1cd2-c636-46ea-a9e3-bb0258f9ad82 req-4bc2f08e-3436-4698-aced-a91f79a35489 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:03.863271 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e38d1cd2-c636-46ea-a9e3-bb0258f9ad82 req-4bc2f08e-3436-4698-aced-a91f79a35489 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Processing event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:04.042672 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Releasing lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:04.043149 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Instance network_info: |[{"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:04.045135 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Start _get_guest_xml network_info=[{"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:04.047479 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:04.049178 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b38f9111-bf01-40bd-ae5e-873de4cb90f3'), owner=OwnerMeta(userid='18cf98c1da954ad0bdb32a5854b3ba36', username='tempest-AttachVolumeMultiAttachTest-1445524669-project-member', projectid='f9de1e5af73b486dbece4a569eeaaa68', projectname='tempest-AttachVolumeMultiAttachTest-1445524669'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052404.0486908) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:04.050533 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:04.051519 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:04.051519 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:20:04.051861 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:04.051931 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Paused (Lifecycle Event) Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:04.056010 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:04.056845 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:04.056845 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:04.056845 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:04.057307 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:04.075512 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Took 8.27 seconds to spawn the instance on the hypervisor. Jul 03 04:20:04.075782 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:04.083797 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-0',id=18,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-cjtxx5mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=b38f9111-bf01-40bd-ae5e-873de4cb90f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:04.084051 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:04.084775 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=19dc47b6-659a-405b-ae05-e44a65ad0894,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19dc47b6-65') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:04.085268 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'pci_devices' on Instance uuid b38f9111-bf01-40bd-ae5e-873de4cb90f3 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:04.347337 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:04.347588 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:04.347892 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attaching volume 3bb72e81-8887-4c25-9d18-198b92bb2860 to /dev/vdb Jul 03 04:20:04.416111 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:04.431464 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:20:04.460997 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:04.500123 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Found WWN 330000000c8fbebcf for multipath device dm-5 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:20:04.501059 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:04.501286 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== connect_volume: return (2042ms) {'type': 'block', 'scsi_wwn': '330000000c8fbebcf', 'path': '/dev/dm-5', 'multipath_id': '330000000c8fbebcf'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:04.502056 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:20:04.502743 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8fbebcf', 'path': '/dev/dm-5', 'multipath_id': '330000000c8fbebcf'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:20:04.502921 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:20:04.513736 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:20:04.515341 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fee7:c0dc', 'fe80::fc16:3eff:fef2:7159', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030', 'fe80::fc16:3eff:fe16:686c', 'fe80::fc16:3eff:feaa:934', 'fe80::a06f:54ff:fec3:97c0', 'fe80::fc16:3eff:fe2f:bdc', 'fe80::fc16:3eff:fe37:9f00', 'fe80::fc16:3eff:fe0c:db0', 'fe80::fc16:3eff:fec7:ef01', 'fe80::4c6d:59ff:fe93:ad89', 'fe80::fc16:3eff:fe93:b88b', 'fe80::94b1:80ff:feba:e837', 'fe80::fc16:3eff:fea6:74be', 'fe80::483:4eff:fe06:c0d8', 'fe80::fc16:3eff:fe92:2d83', 'fe80::c95:f2ff:fea6:c330', 'fe80::fc16:3eff:fe83:2099'] Jul 03 04:20:04.517203 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:20:04.517303 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:20:04.517538 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:04.517729 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating existing volume attachment record: 5fdf77b6-671f-4d85-974a-2009d7441a61 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:20:04.571718 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:04.578859 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:04.578859 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Resumed (Lifecycle Event) Jul 03 04:20:04.586464 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Took 14.00 seconds to build instance. Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] End _get_guest_xml xml= Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: b38f9111-bf01-40bd-ae5e-873de4cb90f3 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: instance-00000012 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: multiattach-server-0 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 2026-07-03 04:20:04 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: True Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: bare Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669-project-member Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: b38f9111-bf01-40bd-ae5e-873de4cb90f3 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: b38f9111-bf01-40bd-ae5e-873de4cb90f3 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: Jul 03 04:20:04.593357 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:04.597141 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Preparing to wait for external event network-vif-plugged-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:04.597141 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:04.597141 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:04.597141 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:04.597943 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-0',id=18,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-cjtxx5mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=b38f9111-bf01-40bd-ae5e-873de4cb90f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:04.597943 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:04.599891 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=19dc47b6-659a-405b-ae05-e44a65ad0894,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19dc47b6-65') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:04.600528 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=19dc47b6-659a-405b-ae05-e44a65ad0894,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19dc47b6-65') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:04.603425 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.604986 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:04.605577 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:04.607771 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.608060 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa6f7833-ebfc-5651-87b3-70140f269703', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:04.618136 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.618961 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:04.625414 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.627961 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.628143 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19dc47b6-65, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:04.628550 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19dc47b6-65, col_values=(('qos', UUID('96c9c1e6-1c4b-443f-95eb-335a293b604a')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:04.628721 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19dc47b6-65, col_values=(('external_ids', {'iface-id': '19dc47b6-659a-405b-ae05-e44a65ad0894', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:30:5c', 'vm-uuid': 'b38f9111-bf01-40bd-ae5e-873de4cb90f3'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:04.629624 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.631975 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:04.641817 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:04.642862 np0000004364 nova-compute[98951]: INFO os_vif [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=19dc47b6-659a-405b-ae05-e44a65ad0894,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19dc47b6-65') Jul 03 04:20:04.688644 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-17596751-2614-4ddd-87cd-1f18972740f2 req-39e31e7a-278e-4c3c-9769-164d2b037a19 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:04.689195 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-17596751-2614-4ddd-87cd-1f18972740f2 req-39e31e7a-278e-4c3c-9769-164d2b037a19 service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:04.689562 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-17596751-2614-4ddd-87cd-1f18972740f2 req-39e31e7a-278e-4c3c-9769-164d2b037a19 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:04.689769 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-17596751-2614-4ddd-87cd-1f18972740f2 req-39e31e7a-278e-4c3c-9769-164d2b037a19 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:04.689931 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-17596751-2614-4ddd-87cd-1f18972740f2 req-39e31e7a-278e-4c3c-9769-164d2b037a19 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:04.690096 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-17596751-2614-4ddd-87cd-1f18972740f2 req-39e31e7a-278e-4c3c-9769-164d2b037a19 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state active and task_state None. Jul 03 04:20:04.702479 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:04.704472 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:04.706062 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance spawned successfully. Jul 03 04:20:04.707409 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:05.010259 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1545140425',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1545140425',id=14,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:19:51Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-o2yuqazi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:51Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=77cf1107-c221-4469-be55-8d94c590491a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:7a:fa:5d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:05.010530 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "vif_mac": "fa:16:3e:7a:fa:5d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:05.012411 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:05.013395 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'pci_devices' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:05.090985 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:20:05.091962 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:05.092142 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:05.092345 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:05.092950 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-a45a60f9-86ea-43a0-a5c3-926bc261eb61 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.513s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:05.093501 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:05.093751 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:20:05.094772 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:05.107765 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:05.109215 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:05.109901 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:05.109901 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:05.110257 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:05.110511 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:05.131984 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:20:05.131984 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:05.157205 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:20:05.157205 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860] added Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:05.170689 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:20:05.171238 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0612(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:20:05.171238 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860] added Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0684(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:20:05.178929 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:20:05.212570 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:05.221629 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:05.221778 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:05.222124 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:05.222388 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:05.222669 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:05.222897 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:05.518232 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] End _get_guest_xml xml= Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: instance-0000000e Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-server-1545140425 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 2026-07-03 04:20:01 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: True Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: bare Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: ide Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: pc Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: tempest-ServerBootFromVolumeStableRescueTest-1451627323 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: 6b296f6f-1224-4410-a9cb-c26d716e7430 Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: Jul 03 04:20:05.519744 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:05.523611 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance destroyed successfully. Jul 03 04:20:05.597427 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:05.598017 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] VM Started (Lifecycle Event) Jul 03 04:20:05.644067 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:05.644281 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:05.662244 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:05.729995 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Took 7.23 seconds to spawn the instance on the hypervisor. Jul 03 04:20:05.730529 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:05.947083 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-875e36ec-5272-4495-b215-358bcc2e4252 req-0419d3c4-8141-4811-9216-8cc551fa5ff1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:05.947663 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-875e36ec-5272-4495-b215-358bcc2e4252 req-0419d3c4-8141-4811-9216-8cc551fa5ff1 service nova] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:05.947844 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-875e36ec-5272-4495-b215-358bcc2e4252 req-0419d3c4-8141-4811-9216-8cc551fa5ff1 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:05.947979 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-875e36ec-5272-4495-b215-358bcc2e4252 req-0419d3c4-8141-4811-9216-8cc551fa5ff1 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:05.948098 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-875e36ec-5272-4495-b215-358bcc2e4252 req-0419d3c4-8141-4811-9216-8cc551fa5ff1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] No waiting events found dispatching network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:05.948201 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-875e36ec-5272-4495-b215-358bcc2e4252 req-0419d3c4-8141-4811-9216-8cc551fa5ff1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received unexpected event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 for instance with vm_state active and task_state None. Jul 03 04:20:06.100233 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:06.102044 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:06.158605 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:06.172066 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:06.172536 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:06.172895 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:06.173085 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:42:30:5c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:06.173551 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Using config drive Jul 03 04:20:06.179340 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:06.190026 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:06.199356 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.206533 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.218929 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.236172 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.236493 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:06.245226 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Took 14.42 seconds to build instance. Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.246942 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.247193 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:06.301040 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.40.100,3260] Jul 03 04:20:06.301040 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.40.100,3260] successful. Jul 03 04:20:06.301040 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.309883 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.50.100,3260] Jul 03 04:20:06.309883 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.50.100,3260] successful. Jul 03 04:20:06.309883 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.321578 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.326954 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.347417 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.348396 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:06.348777 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.239s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:06.348895 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.350872 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:06.351308 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:06.351804 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:06.352253 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] HCTL ('12', '-', '-', 0) found on session 36 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:06.352446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:06.353781 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] HCTL ('11', '-', '-', 0) found on session 35 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:06.353914 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:06.376401 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching for a device in session 36 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:06.376401 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:06.376401 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching for a device in session 35 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:06.376401 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:06.606106 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:06.606493 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] VM Paused (Lifecycle Event) Jul 03 04:20:06.684738 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:06.747697 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:06.747907 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:06.751178 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:06.751962 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-aeca0b1e-0c1d-4e40-b5cc-005b855587e7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "b991be57-007c-4b9b-9d28-b80d662100a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.939s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:06.752151 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Claim successful on node np0000004364 Jul 03 04:20:06.847936 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Creating config drive at /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk.config Jul 03 04:20:06.859151 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5_03d5_y {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:06.924132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5_03d5_y" returned: 0 in 0.065s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:07.048897 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:07.049067 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:07.049222 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:07.049425 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] No VIF found with MAC fa:16:3e:7a:fa:5d, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:07.050102 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Using config drive Jul 03 04:20:07.109668 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:07.111006 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:20:07.112874 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:07.113022 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] VM Resumed (Lifecycle Event) Jul 03 04:20:07.444278 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:07.487739 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:07.555068 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'ec2_ids' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:07.591560 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:07.616956 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:07.620659 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:07.629921 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Rescuing Jul 03 04:20:07.631577 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:07.631760 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquired lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:07.631976 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:07.646602 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:07.653006 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:07.994642 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:08.063967 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:08.064154 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'keypairs' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:08.125722 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] During sync_power_state the instance has a pending task (rescuing). Skip. Jul 03 04:20:08.134474 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:08.139447 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Found WWN 3300000006e44275e for multipath device dm-4 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:20:08.140040 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:08.140412 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000006e44275e', 'path': '/dev/dm-4', 'multipath_id': '3300000006e44275e'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:08.140678 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006e44275e', 'path': '/dev/dm-4', 'multipath_id': '3300000006e44275e'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:20:08.146089 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'flavor' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:08.447546 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:08.447747 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] VM Started (Lifecycle Event) Jul 03 04:20:08.567313 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:08.572140 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:08.595955 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:08.596199 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:08.642036 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attempting to attach volume 3bb72e81-8887-4c25-9d18-198b92bb2860 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] attach device xml: Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: 3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: Jul 03 04:20:08.652354 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:20:08.736308 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Creating config drive at /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config.rescue Jul 03 04:20:08.738757 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbz7clap9 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:08.795741 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbz7clap9" returned: 0 in 0.057s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:08.815110 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Updating instance_info_cache with network_info: [{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:08.953006 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:08.973714 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:08.973714 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] VM Paused (Lifecycle Event) Jul 03 04:20:09.101586 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:09.280878 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.320016 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Releasing lock "refresh_cache-b991be57-007c-4b9b-9d28-b80d662100a9" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:09.322991 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.328699 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.418685 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.472984 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.474525 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.476215 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:09.478935 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:09.614532 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.866s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:09.615082 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:20:09.630172 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.827602 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:09.934578 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2454dc47-083b-4731-b1b4-c42a4cecc006 req-c4582a8d-6541-49d0-b760-168b896734a2 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Received event network-vif-plugged-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:09.935100 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2454dc47-083b-4731-b1b4-c42a4cecc006 req-c4582a8d-6541-49d0-b760-168b896734a2 service nova] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:09.935515 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2454dc47-083b-4731-b1b4-c42a4cecc006 req-c4582a8d-6541-49d0-b760-168b896734a2 service nova] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:09.935749 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2454dc47-083b-4731-b1b4-c42a4cecc006 req-c4582a8d-6541-49d0-b760-168b896734a2 service nova] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:09.935953 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2454dc47-083b-4731-b1b4-c42a4cecc006 req-c4582a8d-6541-49d0-b760-168b896734a2 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Processing event network-vif-plugged-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:09.937567 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:09.942047 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:09.945758 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Instance spawned successfully. Jul 03 04:20:09.946203 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:09.984643 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:20:09.985009 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:09.985183 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] VM Resumed (Lifecycle Event) Jul 03 04:20:10.125625 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:20:10.125902 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:20:10.128024 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:10.128024 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:10.166983 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-657c8570-bcff-4c75-bf9a-d22e71a409f7 req-e7837c44-7d42-49ac-9cad-9912a66a69ff service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:10.167224 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-657c8570-bcff-4c75-bf9a-d22e71a409f7 req-e7837c44-7d42-49ac-9cad-9912a66a69ff service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:10.167590 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-657c8570-bcff-4c75-bf9a-d22e71a409f7 req-e7837c44-7d42-49ac-9cad-9912a66a69ff service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:10.167833 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-657c8570-bcff-4c75-bf9a-d22e71a409f7 req-e7837c44-7d42-49ac-9cad-9912a66a69ff service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:10.167833 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-657c8570-bcff-4c75-bf9a-d22e71a409f7 req-e7837c44-7d42-49ac-9cad-9912a66a69ff service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:10.167966 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-657c8570-bcff-4c75-bf9a-d22e71a409f7 req-e7837c44-7d42-49ac-9cad-9912a66a69ff service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state active and task_state rescuing. Jul 03 04:20:10.242614 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:10.289345 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8291a3e27ced4dae9272827563b8f819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3628de66374638b6a90f8481b23f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:20:10.344602 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-a96f4ea3-3e9c-4158-8dde-b33aa7beabf7 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:10.347787 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:10.347929 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:10.348023 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:10.348124 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No VIF found with MAC fa:16:3e:ee:b5:97, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:10.456748 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:10.456943 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:10.457346 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:10.460499 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:10.460790 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:10.461019 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:10.489969 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:10.495595 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:10.630050 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:10.852386 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Successfully created port: b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:10.977226 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Took 9.63 seconds to spawn the instance on the hypervisor. Jul 03 04:20:10.977226 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:11.001597 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:20:11.001597 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 77cf1107-c221-4469-be55-8d94c590491a due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:11.001819 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:11.001819 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Resumed (Lifecycle Event) Jul 03 04:20:11.010056 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.015089 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.048306 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.136787 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:11.214729 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:11.214898 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.215528 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Cleaning up deleted instances {{(pid=98951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12095}} Jul 03 04:20:11.220916 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.234036 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.321502 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.330306 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:11.357817 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance destroyed successfully. Jul 03 04:20:11.358263 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'numa_topology' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:11.500896 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Took 17.39 seconds to build instance. Jul 03 04:20:11.507673 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:11.512110 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:11.720796 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] There are 0 instances to clean {{(pid=98951) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12104}} Jul 03 04:20:11.723054 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:11.724440 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Cleaning up deleted instances with incomplete migration {{(pid=98951) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12133}} Jul 03 04:20:11.857341 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Successfully updated port: b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:11.865788 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Attempting rescue Jul 03 04:20:11.866772 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 03 04:20:11.874088 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance directory exists: not creating {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 03 04:20:11.874221 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Creating image(s) Jul 03 04:20:11.874901 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "/opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:11.875057 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:11.875626 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:11.876614 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'trusted_certs' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:11.937284 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-4dc82601-646d-44d4-ad0f-1b09da398f46 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.590s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.003136 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-968f0aa0-2caa-46fe-9a66-68d554313767 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.910s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.015025 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:12.015419 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Started (Lifecycle Event) Jul 03 04:20:12.016063 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:12.051787 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4c220dfd-6ff5-4926-bcf8-06ed21322621 req-ffca2dc3-f3a9-479f-828c-3daaf131c3c2 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Received event network-vif-plugged-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:12.051787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4c220dfd-6ff5-4926-bcf8-06ed21322621 req-ffca2dc3-f3a9-479f-828c-3daaf131c3c2 service nova] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.051787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4c220dfd-6ff5-4926-bcf8-06ed21322621 req-ffca2dc3-f3a9-479f-828c-3daaf131c3c2 service nova] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.051787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4c220dfd-6ff5-4926-bcf8-06ed21322621 req-ffca2dc3-f3a9-479f-828c-3daaf131c3c2 service nova] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.051787 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4c220dfd-6ff5-4926-bcf8-06ed21322621 req-ffca2dc3-f3a9-479f-828c-3daaf131c3c2 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] No waiting events found dispatching network-vif-plugged-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:12.051787 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-4c220dfd-6ff5-4926-bcf8-06ed21322621 req-ffca2dc3-f3a9-479f-828c-3daaf131c3c2 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Received unexpected event network-vif-plugged-19dc47b6-659a-405b-ae05-e44a65ad0894 for instance with vm_state active and task_state None. Jul 03 04:20:12.116853 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Unrescuing Jul 03 04:20:12.117460 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:12.117601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquired lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:12.117722 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:12.148397 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:12.149319 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:12.149632 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Creating image(s) Jul 03 04:20:12.150008 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "/opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.150339 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "/opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.151284 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "/opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.151866 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.155053 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.156543 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.227039 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:12.252405 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.096s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.252972 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.253633 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.255188 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.262628 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.263317 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.296238 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:12.296747 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.297306 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.297306 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.297306 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:12.298533 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:12.298533 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-vif-unplugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:12.298533 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.298533 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.298711 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.299668 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] No waiting events found dispatching network-vif-unplugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:12.299668 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received unexpected event network-vif-unplugged-1c4a0dea-a323-4809-9b68-25896065a092 for instance with vm_state active and task_state rescuing. Jul 03 04:20:12.299668 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-vif-unplugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:12.299668 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.299836 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.299986 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.300143 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] No waiting events found dispatching network-vif-unplugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:12.300251 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received unexpected event network-vif-unplugged-1c4a0dea-a323-4809-9b68-25896065a092 for instance with vm_state active and task_state rescuing. Jul 03 04:20:12.300410 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-changed-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:12.300557 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Refreshing instance network info cache due to event network-changed-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:12.300733 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Acquiring lock "refresh_cache-763d288c-14bd-4ae1-b6bb-adf487165e5c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:12.301312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Acquired lock "refresh_cache-763d288c-14bd-4ae1-b6bb-adf487165e5c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:12.301312 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Refreshing network info cache for port b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:12.359227 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "refresh_cache-763d288c-14bd-4ae1-b6bb-adf487165e5c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:12.363540 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.100s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.364254 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.380844 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:12.389701 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.395793 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.401087 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.427487 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk 1073741824" returned: 0 in 0.063s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.428254 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.175s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.428677 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.432412 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.030s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.432412 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.436425 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:12.436858 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.520924 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:12.528732 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:12.542610 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.106s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.543095 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.563726 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Rescuing Jul 03 04:20:12.564874 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:12.564874 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:12.565057 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:12.576199 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.147s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.576803 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:20:12.577306 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:12.597972 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue" returned: 0 in 0.052s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.597972 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.166s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.597972 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'migration_context' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:12.621682 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:12.675918 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:12.676427 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Cannot resize image /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:20:12.676879 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:12.677192 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Ensure instance console log exists: /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:12.677523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:12.677793 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:12.678051 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:12.729816 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:20:12.804010 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:12.924902 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:13.031342 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:13.033934 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 03 04:20:13.034538 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999753027999986 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:13.062226 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004813010000361828 future=) was cancelled during its delay period, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:13.064161 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:13.064601 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.969682883999894 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:13.064723 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.96954122399984 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:13.078015 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:13.096680 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:13.103300 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:13.103746 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:13.105271 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Start _get_guest_xml network_info=[{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:83:20:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue={'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:13.105748 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'resources' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:13.213206 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updating instance_info_cache with network_info: [{"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:13.442453 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:13.442897 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:13.445555 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:13.598996 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8c1c2d60-6f9f-4f30-9b28-677ffd7bf3eb req-38fe5031-516e-4c66-a618-ea2da1b1645b service nova] Releasing lock "refresh_cache-763d288c-14bd-4ae1-b6bb-adf487165e5c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:13.601763 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquired lock "refresh_cache-763d288c-14bd-4ae1-b6bb-adf487165e5c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:13.601971 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:13.607867 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:13.612566 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:13.613599 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-425422393', uuid='b991be57-007c-4b9b-9d28-b80d662100a9'), owner=OwnerMeta(userid='af92ec9d358c4fcd997ca5ca9acfe7c3', username='tempest-ServerRescueNegativeTestJSON-764277257-project-member', projectid='82604b4949eb47659d954def4e326795', projectname='tempest-ServerRescueNegativeTestJSON-764277257'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:83:20:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052413.612943) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:13.614623 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:13.615056 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:13.620715 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'vcpu_model' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:13.677359 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:13.715272 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Releasing lock "refresh_cache-77cf1107-c221-4469-be55-8d94c590491a" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:13.716026 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'flavor' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:13.729352 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:13.729733 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:13.729999 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 03 04:20:13.730362 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:20:13.946965 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:14.123158 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:14.134908 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-425422393',display_name='tempest-ServerRescueNegativeTestJSON-server-425422393',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-425422393',id=17,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:20:05Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-lvvxz665',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:06Z,user_data=None,user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=b991be57-007c-4b9b-9d28-b80d662100a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:83:20:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:14.138378 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "1c4a0dea-a323-4809-9b68-25896065a092", "address": "fa:16:3e:83:20:99", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:83:20:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4a0dea-a3", "ovs_interfaceid": "1c4a0dea-a323-4809-9b68-25896065a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:14.140827 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:99,bridge_name='br-int',has_traffic_filtering=True,id=1c4a0dea-a323-4809-9b68-25896065a092,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4a0dea-a3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:14.143743 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Received event network-changed-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:14.143743 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Refreshing instance network info cache due to event network-changed-19dc47b6-659a-405b-ae05-e44a65ad0894. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:14.143743 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] Acquiring lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:14.149647 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] Acquired lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:14.149647 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Refreshing network info cache for port 19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:14.151762 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'pci_devices' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:14.182712 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:14.211804 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:14.213668 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:14.215065 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:14.215384 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:20:14.255285 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:14.259242 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:14.284447 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:14.377110 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:14.377223 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:14.443959 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:14.448274 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-edd57c5f-edb4-442d-8239-7c9d3e9813c0 req-6af355ff-b90f-4b57-b29f-85c0b381cda7 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:14.448583 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-edd57c5f-edb4-442d-8239-7c9d3e9813c0 req-6af355ff-b90f-4b57-b29f-85c0b381cda7 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:14.448802 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-edd57c5f-edb4-442d-8239-7c9d3e9813c0 req-6af355ff-b90f-4b57-b29f-85c0b381cda7 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:14.449288 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-edd57c5f-edb4-442d-8239-7c9d3e9813c0 req-6af355ff-b90f-4b57-b29f-85c0b381cda7 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:14.449516 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-edd57c5f-edb4-442d-8239-7c9d3e9813c0 req-6af355ff-b90f-4b57-b29f-85c0b381cda7 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:14.449687 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-edd57c5f-edb4-442d-8239-7c9d3e9813c0 req-6af355ff-b90f-4b57-b29f-85c0b381cda7 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:14.457094 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:14.485815 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:14.533132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:14.533551 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:14.539150 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:14.539279 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Claim successful on node np0000004364 Jul 03 04:20:14.595816 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999436057000139 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:14.598888 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance destroyed successfully. Jul 03 04:20:14.598888 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'numa_topology' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:14.631797 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:14.654991 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] End _get_guest_xml xml= Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: b991be57-007c-4b9b-9d28-b80d662100a9 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: instance-00000011 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-server-425422393 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 2026-07-03 04:20:13 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: True Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: bare Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: ide Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: pc Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257-project-member Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: b991be57-007c-4b9b-9d28-b80d662100a9 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: b991be57-007c-4b9b-9d28-b80d662100a9 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: Jul 03 04:20:14.656272 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:14.658920 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Updating instance_info_cache with network_info: [{"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:14.660139 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:14.663674 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Instance destroyed successfully. Jul 03 04:20:14.883774 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:15.083038 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:15.103011 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Object Instance<77cf1107-c221-4469-be55-8d94c590491a> lazy-loaded attributes: flavor,numa_topology {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:15.163618 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Releasing lock "refresh_cache-763d288c-14bd-4ae1-b6bb-adf487165e5c" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:15.164362 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Instance network_info: |[{"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:15.165441 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Start _get_guest_xml network_info=[{"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:15.168104 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:15.169468 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1804844329', uuid='763d288c-14bd-4ae1-b6bb-adf487165e5c'), owner=OwnerMeta(userid='8291a3e27ced4dae9272827563b8f819', username='tempest-ServersNegativeTestJSON-77201445-project-member', projectid='fc3628de66374638b6a90f8481b23f1a', projectname='tempest-ServersNegativeTestJSON-77201445'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052415.169074) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:15.178871 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:15.179677 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:15.183247 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:15.183522 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:15.184502 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:15.184962 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:15.185070 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:15.185167 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:15.185296 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:15.185398 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:15.185485 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:15.185643 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:15.185735 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:15.185846 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:15.186048 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:15.186166 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:15.197165 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1804844329',display_name='tempest-ServersNegativeTestJSON-server-1804844329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serversnegativetestjson-server-1804844329',id=19,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3628de66374638b6a90f8481b23f1a',ramdisk_id='',reservation_id='r-wepo064q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-77201445',owner_user_name='tempest-ServersNegativeTestJSON-77201445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:11Z,user_data=None,user_id='8291a3e27ced4dae9272827563b8f819',uuid=763d288c-14bd-4ae1-b6bb-adf487165e5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:15.197697 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converting VIF {"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:15.198371 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:15.198915 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lazy-loading 'pci_devices' on Instance uuid 763d288c-14bd-4ae1-b6bb-adf487165e5c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:15.214059 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:15.214690 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:15.215181 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:20:15.238376 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.264044 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updated VIF entry in instance network info cache for port 19dc47b6-659a-405b-ae05-e44a65ad0894. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:15.264538 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updating instance_info_cache with network_info: [{"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:15.461743 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:15.557256 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.601475 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.699638 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] End _get_guest_xml xml= Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 763d288c-14bd-4ae1-b6bb-adf487165e5c Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: instance-00000013 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: tempest-ServersNegativeTestJSON-server-1804844329 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 2026-07-03 04:20:15 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: True Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: bare Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: tempest-ServersNegativeTestJSON-77201445-project-member Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: tempest-ServersNegativeTestJSON-77201445 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 763d288c-14bd-4ae1-b6bb-adf487165e5c Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 763d288c-14bd-4ae1-b6bb-adf487165e5c Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: Jul 03 04:20:15.701682 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:15.703782 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Preparing to wait for external event network-vif-plugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:15.703782 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:15.703782 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:15.703782 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:15.704226 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1804844329',display_name='tempest-ServersNegativeTestJSON-server-1804844329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serversnegativetestjson-server-1804844329',id=19,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3628de66374638b6a90f8481b23f1a',ramdisk_id='',reservation_id='r-wepo064q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-77201445',owner_user_name='tempest-ServersNegativeTestJSON-77201445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:11Z,user_data=None,user_id='8291a3e27ced4dae9272827563b8f819',uuid=763d288c-14bd-4ae1-b6bb-adf487165e5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:15.704226 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converting VIF {"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:15.705878 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:15.705878 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:15.705878 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.705878 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:15.705878 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:15.709655 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.709655 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7ed3346-0449-5576-8e1b-5c230573ccdc', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:15.709655 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.709655 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:15.738640 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.745604 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.745824 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb98a1cf1-f7, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:15.746168 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb98a1cf1-f7, col_values=(('qos', UUID('12d0d3cd-6a7b-4ea7-a3c4-a66e3e99e206')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:15.746564 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb98a1cf1-f7, col_values=(('external_ids', {'iface-id': 'b98a1cf1-f7f3-4a04-9fe9-1a6541705adf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:1a:7a', 'vm-uuid': '763d288c-14bd-4ae1-b6bb-adf487165e5c'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:15.747415 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.749575 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:15.757535 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.760853 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.761790 np0000004364 nova-compute[98951]: INFO os_vif [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') Jul 03 04:20:15.766778 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-58b39848-a687-44f3-9a56-b3ae05990a04 req-13f53882-ce6f-4b23-84ec-90921110b638 service nova] Releasing lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:15.772555 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.890736 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.893223 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.919865 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.924421 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:15.968043 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.141523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6310c4cb-df17-4bc3-9dfc-bc1a7f81f71c req-ffa7bff9-e65e-4f13-9f18-4183e7f9c72e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:16.145671 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6310c4cb-df17-4bc3-9dfc-bc1a7f81f71c req-ffa7bff9-e65e-4f13-9f18-4183e7f9c72e service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.145999 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6310c4cb-df17-4bc3-9dfc-bc1a7f81f71c req-ffa7bff9-e65e-4f13-9f18-4183e7f9c72e service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.146520 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6310c4cb-df17-4bc3-9dfc-bc1a7f81f71c req-ffa7bff9-e65e-4f13-9f18-4183e7f9c72e service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:16.146802 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6310c4cb-df17-4bc3-9dfc-bc1a7f81f71c req-ffa7bff9-e65e-4f13-9f18-4183e7f9c72e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:16.146962 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-6310c4cb-df17-4bc3-9dfc-bc1a7f81f71c req-ffa7bff9-e65e-4f13-9f18-4183e7f9c72e service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state rescuing. Jul 03 04:20:16.207202 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:16.207791 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99928227600003 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:16.208227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:16.209185 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:16.209185 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No VIF found with MAC fa:16:3e:83:20:99, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:16.210016 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Using config drive Jul 03 04:20:16.211017 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance destroyed successfully. Jul 03 04:20:16.211384 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'numa_topology' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:16.217819 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:16.217819 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager.update_available_resource {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:20:16.238819 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.239245 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.239503 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.239776 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.239832 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:16.242649 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Terminating instance Jul 03 04:20:16.371494 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:16.371697 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:16.510906 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:16.511447 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.511589 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.511717 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:16.511913 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:16.512009 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:16.512403 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:16.512403 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.512518 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.512518 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:16.512652 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:16.512763 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:16.512859 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:16.512978 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.513101 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.513216 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:16.513381 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:16.513485 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2fe6956a-a508-4850-98bf-78811e7a88a7 req-d7865c96-d9f3-4698-ad8d-f343b2bb6878 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received unexpected event network-vif-plugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:16.594290 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 77cf1107-c221-4469-be55-8d94c590491a due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:16.594559 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:16.594677 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Resumed (Lifecycle Event) Jul 03 04:20:16.597215 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-85cfb496-91f6-4d1f-8454-5faf360221b8 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:16.719550 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'ec2_ids' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:16.724294 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.724826 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attempting a stable device rescue Jul 03 04:20:16.751114 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:16.792394 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.832049 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 03 04:20:16.833644 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.840261 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance directory exists: not creating {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 03 04:20:16.840407 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Creating image(s) Jul 03 04:20:16.841938 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:16.842339 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:16.843002 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:16.843255 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:16.858259 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.874477 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:16.879808 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.894456 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.987786 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.995515 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:16.996371 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.079567 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.098959 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:17.106847 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:17.200309 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.224852 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:17.224852 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'keypairs' on Instance uuid b991be57-007c-4b9b-9d28-b80d662100a9 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:17.269633 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.284931 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.301978 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:17.302581 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:17.302581 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] No VIF found with MAC fa:16:3e:dc:1a:7a, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:17.303057 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Using config drive Jul 03 04:20:17.317893 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.351212 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:17.354363 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "6067650ac8c6431cd452f6887ccf0aacd269da19" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:17.357528 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "6067650ac8c6431cd452f6887ccf0aacd269da19" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:17.373915 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.384054 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.850s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:17.384421 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:20:17.387431 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.926s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:17.393473 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:17.393473 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Claim successful on node np0000004364 Jul 03 04:20:17.470586 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:17.519561 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Instance destroyed successfully. Jul 03 04:20:17.520838 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lazy-loading 'resources' on Instance uuid a17998b3-c8a4-48e0-b311-b828734699cc {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:17.610866 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:17.612132 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Started (Lifecycle Event) Jul 03 04:20:17.729764 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:17.729764 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:17.760050 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:17.760358 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:17.810907 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:17.899390 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:20:17.900543 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:20:17.901525 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:17.901954 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:17.950420 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:17.950625 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:17.950830 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:17.951102 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:17.951187 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:17.955731 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Terminating instance Jul 03 04:20:17.991670 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Creating config drive at /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.config.rescue Jul 03 04:20:17.997107 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0ad9qw56 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:18.026564 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.026842 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "address": "fa:16:3e:16:68:6c", "network": {"id": "e40f8b18-401e-471d-a3b2-9e2449c3a78b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-122044811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba38f-fd", "ovs_interfaceid": "252ba38f-fd86-45a7-bde9-bf8990e3b9d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.028017 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.028389 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.032051 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.032651 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap252ba38f-fd, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.041876 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ca140c204734e4fbf4eda5377f08fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f692daeca94508859887b79b6f1ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:20:18.048521 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.065570 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Creating config drive at /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk.config Jul 03 04:20:18.066477 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0ad9qw56" returned: 0 in 0.071s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:18.073349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_x_tlwce {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:18.087782 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.094417 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.095091 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce39388b-7b95-4974-b69e-5614aa6350c6) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.098425 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.122357 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:18.125719 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:18.144273 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_x_tlwce" returned: 0 in 0.070s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:18.148756 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.153898 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:68:6c,bridge_name='br-int',has_traffic_filtering=True,id=252ba38f-fd86-45a7-bde9-bf8990e3b9d8,network=Network(e40f8b18-401e-471d-a3b2-9e2449c3a78b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba38f-fd') Jul 03 04:20:18.154877 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.155365 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "address": "fa:16:3e:aa:09:34", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb1b1e3e-fe", "ovs_interfaceid": "eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.156042 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.156314 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.162219 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.162609 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb1b1e3e-fe, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.163838 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.164694 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.215177 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.216431 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.216601 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d448f86-a6a8-4870-a803-cb54bdd491b8) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.221382 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.221382 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.263030 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:18.271347 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state rescuing. Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.282349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.284924 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.287289 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.287464 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.287584 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.287710 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.287837 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.287940 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.288055 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.288175 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.291738 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.293083 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.293189 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.293340 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.293517 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.293648 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.293749 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.293958 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.294108 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ba0da391-89fb-4fec-b3de-f0ce2b5eeffc req-6f8881b6-2c2b-4c5a-ad73-f5f0a8318acc service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.294621 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:09:34,bridge_name='br-int',has_traffic_filtering=True,id=eb1b1e3e-fe3a-4a75-ac10-d6c5c55e7cac,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb1b1e3e-fe') Jul 03 04:20:18.295266 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.295591 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "address": "fa:16:3e:2f:0b:dc", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856fb16-4e", "ovs_interfaceid": "c856fb16-4e16-4e1f-aee0-2be9422ac0d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.296161 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.296436 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.298115 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.298338 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc856fb16-4e, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.311763 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.313179 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.353586 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.355216 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.355590 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5751e19-e3df-46fa-8769-2849be2f4354) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.357146 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.359485 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.398282 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.402318 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:18.407429 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0b:dc,bridge_name='br-int',has_traffic_filtering=True,id=c856fb16-4e16-4e1f-aee0-2be9422ac0d5,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc856fb16-4e') Jul 03 04:20:18.408059 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.408276 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "address": "fa:16:3e:37:9f:00", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55a7c12-ce", "ovs_interfaceid": "c55a7c12-cefb-4547-ab80-3fd1eb3a14c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.408726 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.409033 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.410537 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.410752 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc55a7c12-ce, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.414307 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.415364 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.448772 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.449723 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.449904 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32185ab1-ce77-4196-91de-d3a655428823) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.451622 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.454021 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.464671 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:18.486851 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.487253 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55a7c12-ce') Jul 03 04:20:18.488069 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.488581 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "e621f500-6f8f-4957-8211-cc80133cca3f", "address": "fa:16:3e:0c:0d:b0", "network": {"id": "a3af19ad-eefc-4d4d-a221-62a036a36980", "bridge": "br-int", "label": "tempest-device-tagging-net1-761500901", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape621f500-6f", "ovs_interfaceid": "e621f500-6f8f-4957-8211-cc80133cca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.489057 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.489367 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.492956 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.493943 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape621f500-6f, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.495774 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.496705 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.527294 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.536253 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.586032 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.588121 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.590237 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.590560 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46c08e21-c0d2-45ad-bc76-a61d05466180) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.591825 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.591825 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.606147 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.607698 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.608058 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c856fb16-4e16-4e1f-aee0-2be9422ac0d5 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-e621f500-6f8f-4957-8211-cc80133cca3f for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-e621f500-6f8f-4957-8211-cc80133cca3f for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.612687 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.613983 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.614212 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.616139 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.616139 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.616400 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.617071 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.617407 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.617712 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.618159 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.618798 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.618798 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-583fc957-b34a-49b7-b85a-d99dce25a38c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.618798 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:18.619559 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.620246 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:18.620246 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:18.620246 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:18.620246 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-9a4d5da0-b5ac-4f74-a233-dae58695944d req-f714d0c0-ad25-4ee0-8f07-22e4fbf42bce service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-583fc957-b34a-49b7-b85a-d99dce25a38c for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:18.629538 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.631812 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] During sync_power_state the instance has a pending task (deleting). Skip. Jul 03 04:20:18.633890 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e621f500-6f8f-4957-8211-cc80133cca3f,network=Network(a3af19ad-eefc-4d4d-a221-62a036a36980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape621f500-6f') Jul 03 04:20:18.635022 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999016508000068 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:18.635490 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.635688 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "583fc957-b34a-49b7-b85a-d99dce25a38c", "address": "fa:16:3e:c7:ef:01", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap583fc957-b3", "ovs_interfaceid": "583fc957-b34a-49b7-b85a-d99dce25a38c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.636343 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.636685 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.637804 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.639164 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap583fc957-b3, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.640966 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.671828 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.672929 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.673124 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75a608d0-db49-497b-9723-538986d5e43d) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.674052 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.674743 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.707484 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.711762 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ef:01,bridge_name='br-int',has_traffic_filtering=True,id=583fc957-b34a-49b7-b85a-d99dce25a38c,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap583fc957-b3') Jul 03 04:20:18.712641 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-938181740',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-938181740',id=11,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKZh2gTQdpCV1UNnxBRt2cCkHqKV70vCrXqCdK98xUpgbrJ0YL/6SRpwG6aYeUU3H3ITcD0zBlQi1Ys4QOovPZHq+7M9r5JdwvZmJwsNsRK8L6dHMXpyhmyiHLzS1CHpQ==',key_name='tempest-keypair-954588564',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:27Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9b71dccbd489492bb2cbdb93a1ba716e',ramdisk_id='',reservation_id='r-74s7qksi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-904864538',owner_user_name='tempest-TaggedBootDevicesTest-904864538-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e5d28fd9a54e719cf8264756f3915f',uuid=a17998b3-c8a4-48e0-b311-b828734699cc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:18.713654 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converting VIF {"id": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "address": "fa:16:3e:93:b8:8b", "network": {"id": "e0d95203-dd80-4554-ac19-15f606c5d429", "bridge": "br-int", "label": "tempest-device-tagging-net2-1421927410", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b71dccbd489492bb2cbdb93a1ba716e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d6f94-8d", "ovs_interfaceid": "f83d6f94-8dc8-4b7b-9ddd-47874b84aa59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:18.713654 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:18.713654 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:18.718537 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.718589 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf83d6f94-8d, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.722315 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.723533 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.727607 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.752111 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.758965 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.758965 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9734ebf-1f9e-4469-9e3b-23a0873c0e6f) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:18.763713 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.763713 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:18.775860 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.802396 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.806371 np0000004364 nova-compute[98951]: INFO os_vif [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b8:8b,bridge_name='br-int',has_traffic_filtering=True,id=f83d6f94-8dc8-4b7b-9ddd-47874b84aa59,network=Network(e0d95203-dd80-4554-ac19-15f606c5d429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d6f94-8d') Jul 03 04:20:18.809059 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:20:18.809538 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:18.809749 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:18.810284 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:18.810780 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15755c61-ebdf-447d-8a59-65387db01927', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:20:18.811210 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:20:18.816723 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Successfully created port: ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:18.862533 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:20:18.865680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '23')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:18.867534 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927', '24')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:18.869638 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Resulting device map defaultdict(. at 0x76c4305f1f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'): ({'sdo'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:20:18.870835 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Removing multipathed devices sdn, sdo {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:20:18.871358 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.872142 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Flush multipath device 3300000008b05f575 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:20:18.897931 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:18.912292 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:18.915457 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.part --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:18.915457 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:18.916624 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:18.960927 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:19.014070 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:19.030501 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.part --force-share --output=json" returned: 0 in 0.116s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:19.030794 np0000004364 nova-compute[98951]: DEBUG nova.virt.images [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] 8a77d654-d3e2-4e1d-b523-f13f16ee71c1 was qcow2, converting to raw {{(pid=98951) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jul 03 04:20:19.031646 np0000004364 nova-compute[98951]: DEBUG nova.privsep.utils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98951) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jul 03 04:20:19.031975 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.part /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.converted {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:19.074730 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:20:19.074976 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:20:19.076864 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:20:19.095456 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:20:19.102861 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:20:19.115742 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.118241 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.164736 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.166377 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.175721 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.40.100,3260] Jul 03 04:20:19.175721 np0000004364 nova-compute[98951]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.40.100,3260] successful. Jul 03 04:20:19.175721 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.201562 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.211932 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99962826900014 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:19.214662 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Instance destroyed successfully. Jul 03 04:20:19.215145 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'resources' on Instance uuid 77cf1107-c221-4469-be55-8d94c590491a {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:19.218807 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.270866 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.50.100,3260] Jul 03 04:20:19.270866 np0000004364 nova-compute[98951]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-15755c61-ebdf-447d-8a59-65387db01927, portal: 192.168.50.100,3260] successful. Jul 03 04:20:19.270866 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.299677 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.300811 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:19.301009 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== disconnect_volume: return (491ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:19.301237 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:20:19.304797 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:20:19.305145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:19.305285 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:19.305934 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:19.306550 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4c52c8d5-59be-4011-adb3-f811202cc535', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:20:19.306731 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:20:19.333128 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.part /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.converted" returned: 0 in 0.301s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.340912 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.341250 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:19.341491 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:20:19.341491 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '25')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:19.342773 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535', '26')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:19.343699 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Resulting device map defaultdict(. at 0x76c4305f0e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'): ({'sdq'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:20:19.344054 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Removing multipathed devices sdp, sdq {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:20:19.345235 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Flush multipath device 3300000006df266b0 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:20:19.350322 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.converted --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:19.366901 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.382875 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:19.400681 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.428359 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Booting with volume e6ee881b-4344-4a43-8c3c-d21965282d36 at /dev/vda Jul 03 04:20:19.444870 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.456076 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:19.457028 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19.converted --force-share --output=json" returned: 0 in 0.107s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:19.459496 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "6067650ac8c6431cd452f6887ccf0aacd269da19" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 2.104s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:19.459858 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:19.463073 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:19.464801 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "6067650ac8c6431cd452f6887ccf0aacd269da19" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:19.465175 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "6067650ac8c6431cd452f6887ccf0aacd269da19" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:19.468975 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:19.473551 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:19.474395 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:19.501875 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:19.512859 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:19.513096 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:19.515221 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:20:19.516831 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:20:19.517681 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:20:19.521294 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:20:19.521294 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.539815 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:20:19.540398 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:20:19.545149 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:19.555402 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.566284 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.568545 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19 --force-share --output=json" returned: 0 in 0.094s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:19.569290 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19,backing_fmt=raw /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.rescue {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:19.581889 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.588385 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:20:19.589622 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:20:19.600910 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:20:19.603030 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fee7:c0dc', 'fe80::fc16:3eff:fef2:7159', 'fe80::fc16:3eff:fea6:74be', 'fe80::483:4eff:fe06:c0d8', 'fe80::fc16:3eff:fe92:2d83', 'fe80::c95:f2ff:fea6:c330', 'fe80::fc16:3eff:fe42:305c', 'fe80::fc16:3eff:fedc:1a7a', 'fe80::a871:1ff:fe80:4c64', 'fe80::fc16:3eff:fe83:2099'] Jul 03 04:20:19.603266 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:20:19.603446 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:20:19.603750 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:19.604124 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updating existing volume attachment record: b90d884b-9c79-4f02-a6db-7f1e996eb9ab {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:20:19.610842 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.40.100,3260] Jul 03 04:20:19.610842 np0000004364 nova-compute[98951]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.40.100,3260] successful. Jul 03 04:20:19.610842 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.628952 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6067650ac8c6431cd452f6887ccf0aacd269da19,backing_fmt=raw /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.rescue" returned: 0 in 0.056s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:19.630964 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "6067650ac8c6431cd452f6887ccf0aacd269da19" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.166s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:19.631477 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'migration_context' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:19.639864 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.653087 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.698233 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.50.100,3260] Jul 03 04:20:19.698233 np0000004364 nova-compute[98951]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-4c52c8d5-59be-4011-adb3-f811202cc535, portal: 192.168.50.100,3260] successful. Jul 03 04:20:19.698233 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.718835 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1545140425',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1545140425',id=14,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:20:10Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-o2yuqazi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:17Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=77cf1107-c221-4469-be55-8d94c590491a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:19.721307 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.722416 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "41beed31-04a2-4b95-9152-d62601cbe2fd", "address": "fa:16:3e:7a:fa:5d", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41beed31-04", "ovs_interfaceid": "41beed31-04a2-4b95-9152-d62601cbe2fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:19.722624 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:19.722961 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:19.723460 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== disconnect_volume: return (417ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:19.724009 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:19.724144 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:20:19.726029 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.727672 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41beed31-04, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:19.728788 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.729546 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:19.730078 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:20:19.730523 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:19.730677 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:19.731270 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:19.731645 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:20:19.732195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:20:19.735073 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.736811 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.736994 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005f3b3d-1884-4131-a571-818c4e964802) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:19.737510 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.738255 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:19.745403 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.751514 np0000004364 nova-compute[98951]: INFO os_vif [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:fa:5d,bridge_name='br-int',has_traffic_filtering=True,id=41beed31-04a2-4b95-9152-d62601cbe2fd,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41beed31-04') Jul 03 04:20:19.753768 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:20:19.753768 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:19.753768 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.769893 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7 (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:19.770293 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:19.770931 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:20:19.771144 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '27')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:19.772445 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7', '28')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:19.773692 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Resulting device map defaultdict(. at 0x76c4305f3ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'): ({'sds'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:20:19.774316 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Removing multipathed devices sdr, sds {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:20:19.774631 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Flush multipath device 330000000afa1d5cb {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:20:19.814465 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:19.847886 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.853730 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:19.864046 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:19.918014 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:20:19.918215 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] SCSI volumes sdr, sds have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:20:19.919895 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:20:19.933583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:20:19.933880 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:20:19.945212 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Successfully updated port: ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:19.948654 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:19.997234 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.40.100,3260] Jul 03 04:20:19.997234 np0000004364 nova-compute[98951]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.40.100,3260] successful. Jul 03 04:20:19.997234 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.019244 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:20.027370 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.041029 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.082762 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.50.100,3260] Jul 03 04:20:20.082762 np0000004364 nova-compute[98951]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-37930cf7-0b3c-45a7-b67c-65f8b73c6fc7, portal: 192.168.50.100,3260] successful. Jul 03 04:20:20.082762 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.102854 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.103241 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:20.103241 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] <== disconnect_volume: return (372ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:20.103340 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:20:20.104514 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.350s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:20.104514 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b296f6f-1224-4410-a9cb-c26d716e7430', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:20:20.104514 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:20:20.105647 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Deleting instance files /opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc_del Jul 03 04:20:20.107418 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Deletion of /opt/stack/data/nova/instances/a17998b3-c8a4-48e0-b311-b828734699cc_del complete Jul 03 04:20:20.140505 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:20.140753 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:20.143557 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Start _get_guest_xml network_info=[{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "vif_mac": "fa:16:3e:ee:b5:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue={'image_id': '8a77d654-d3e2-4e1d-b523-f13f16ee71c1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'attachment_id': '5fdf77b6-671f-4d85-974a-2009d7441a61', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '8797c544-317e-4ae4-9a84-512976e3225f', 'attached_at': '', 'detached_at': '', 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'serial': '3bb72e81-8887-4c25-9d18-198b92bb2860'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:20.143882 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'resources' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:20.145771 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430 (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:20.146190 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:20.146498 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:20:20.146498 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '34')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:20.147571 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430', '33')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:20.149718 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Resulting device map defaultdict(. at 0x76c4502d4c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'): ({'sdh'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:20:20.152021 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Removing multipathed devices sdi, sdh {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:20:20.152386 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flush multipath device 330000000c8fbebcf {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:20:20.217061 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:20.240572 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:20.266103 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:20.311590 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:20.311836 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] VM Started (Lifecycle Event) Jul 03 04:20:20.316212 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:20:20.316376 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:20:20.317445 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:20:20.328353 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:20:20.328601 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:20:20.341012 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.384036 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.40.100,3260] Jul 03 04:20:20.384036 np0000004364 nova-compute[98951]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.40.100,3260] successful. Jul 03 04:20:20.384036 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.403025 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.414653 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.448365 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:20.448498 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquired lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:20.448634 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:20.450213 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.50.100,3260] Jul 03 04:20:20.450213 np0000004364 nova-compute[98951]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-6b296f6f-1224-4410-a9cb-c26d716e7430, portal: 192.168.50.100,3260] successful. Jul 03 04:20:20.450213 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.468045 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:20.468341 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:20.468539 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== disconnect_volume: return (714ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:20.468679 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:20:20.468934 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Deleting instance files /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a_del Jul 03 04:20:20.469533 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Deletion of /opt/stack/data/nova/instances/77cf1107-c221-4469-be55-8d94c590491a_del complete Jul 03 04:20:20.498535 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-88a7ade8-e494-4bf9-a225-dcf36809e25d tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:20.529932 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.143s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:20.530573 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:20:20.535119 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.810s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:20.535234 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:20.536220 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.673s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:20.536693 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:20:20.539684 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:20.540273 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Claim successful on node np0000004364 Jul 03 04:20:20.617106 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Took 3.87 seconds to destroy the instance on the hypervisor. Jul 03 04:20:20.617650 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:20.617878 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:20.618430 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:20.618620 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:20.646562 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:20.652089 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:20.653642 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-589779902', uuid='8797c544-317e-4ae4-9a84-512976e3225f'), owner=OwnerMeta(userid='9f382e83c876463dac1650a3f0272ec5', username='tempest-ServerStableDeviceRescueTest-645362785-project-member', projectid='662ad5b7bca441b387156b61f2272bff', projectname='tempest-ServerStableDeviceRescueTest-645362785'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "vif_mac": "fa:16:3e:ee:b5:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052420.6531768) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:20.655190 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:20.655743 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:20.658201 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:20.658863 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:20.659870 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:20.660556 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:20.660738 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:20.661031 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:20.661232 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:20.661404 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:20.661861 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:20.662039 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:20.662193 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:20.662313 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:20.662517 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:20.662598 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:20.662926 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:20.691751 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:20.691829 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:20.691989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:20.694459 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:20.695591 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:20.696585 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:20.696770 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:20.696982 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "77cf1107-c221-4469-be55-8d94c590491a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:20.697294 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:20.697416 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "77cf1107-c221-4469-be55-8d94c590491a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:20.697581 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] No waiting events found dispatching network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:20.697735 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-unplugged-41beed31-04a2-4b95-9152-d62601cbe2fd for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:20.697916 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-plugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:20.698089 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:20.698286 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:20.698566 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:20.698703 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Processing event network-vif-plugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:20.699666 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-plugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:20.700556 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:20.700754 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:20.701055 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:20.701094 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:20.701221 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] No waiting events found dispatching network-vif-plugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:20.701365 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received unexpected event network-vif-plugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf for instance with vm_state building and task_state spawning. Jul 03 04:20:20.701574 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-changed-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:20.701676 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Refreshing instance network info cache due to event network-changed-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:20.701789 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:20.706233 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:20.708433 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Instance spawned successfully. Jul 03 04:20:20.708890 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:20.814665 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:20.816376 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:20.846759 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:20.979052 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Took 2.51 seconds to destroy the instance on the hypervisor. Jul 03 04:20:20.979769 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:20.980154 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:20.980231 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:20.980531 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:21.050082 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:21.056252 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:20:21.056448 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:20:21.056714 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:21.056977 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:21.167343 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:21.169214 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:21.190449 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:21.236726 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18cf98c1da954ad0bdb32a5854b3ba36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9de1e5af73b486dbece4a569eeaaa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:20:21.247697 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:21.247958 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:21.248627 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:21.249437 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:21.250123 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:21.251223 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:21.304243 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config --force-share --output=json" returned: 0 in 0.114s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:21.305175 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:21.305524 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:21.306058 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "/opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:21.306427 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:20:21.306729 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:21.306897 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:21.307224 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:21.307510 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:20:21.320425 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:20:21.322489 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:21.322873 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] VM Paused (Lifecycle Event) Jul 03 04:20:21.328523 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:21.330400 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:21.331126 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:21.332496 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:21.332819 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:21.332922 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:21.348311 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:21.359054 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:21.365709 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:21.377455 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:21.379991 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.388742 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.389281 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:21.389521 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:21.389603 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:21.390170 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] HCTL ('11', '0', '0', 0) found on session 35 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:21.390741 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.400112 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:21.400405 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:21.400636 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:21.400797 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:21.402586 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] HCTL ('12', '0', '0', 0) found on session 36 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:21.402754 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:21.403249 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching for a device in session 35 and hctl ('11', '0', '0', 0) yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:21.406193 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:21.414606 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Searching for a device in session 36 and hctl ('12', '0', '0', 0) yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:21.414804 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:21.562178 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:21.599175 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:21.664425 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updating instance_info_cache with network_info: [{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:21.715521 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:21.716065 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:21.754808 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:21.756967 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:21.757528 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Creating image(s) Jul 03 04:20:21.770144 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Took 9.61 seconds to spawn the instance on the hypervisor. Jul 03 04:20:21.773402 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:21.775622 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:20:21.777134 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Ensure instance console log exists: /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:21.783451 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:21.785770 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:21.787792 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:21.791926 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-457d3df4-7c0b-45fe-b973-0713ea9cac0f req-fa0de76c-9848-4b87-b3b1-99d9ae481a2e service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:21.792211 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-457d3df4-7c0b-45fe-b973-0713ea9cac0f req-fa0de76c-9848-4b87-b3b1-99d9ae481a2e service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:21.792400 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-457d3df4-7c0b-45fe-b973-0713ea9cac0f req-fa0de76c-9848-4b87-b3b1-99d9ae481a2e service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:21.792531 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-457d3df4-7c0b-45fe-b973-0713ea9cac0f req-fa0de76c-9848-4b87-b3b1-99d9ae481a2e service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:21.792644 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-457d3df4-7c0b-45fe-b973-0713ea9cac0f req-fa0de76c-9848-4b87-b3b1-99d9ae481a2e service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:21.799454 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-457d3df4-7c0b-45fe-b973-0713ea9cac0f req-fa0de76c-9848-4b87-b3b1-99d9ae481a2e service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:21.831693 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:21.832150 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:21.837876 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:21.838203 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for b991be57-007c-4b9b-9d28-b80d662100a9 due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:21.838316 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:21.840641 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] VM Resumed (Lifecycle Event) Jul 03 04:20:21.954589 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:21.955076 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:21.981851 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Successfully created port: ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:22.049519 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.053600 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:20:22.053900 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.079533 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:22.156628 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.157166 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.179275 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Releasing lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:22.180912 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance network_info: |[{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:22.182047 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquired lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:22.182459 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Refreshing network info cache for port ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:22.187508 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Start _get_guest_xml network_info=[{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b90d884b-9c79-4f02-a6db-7f1e996eb9ab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '683d1775-ad4b-4200-9d1d-ef75e6c95064', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'serial': 'e6ee881b-4344-4a43-8c3c-d21965282d36'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:22.194234 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:22.195917 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-57277548', uuid='683d1775-ad4b-4200-9d1d-ef75e6c95064'), owner=OwnerMeta(userid='2ca140c204734e4fbf4eda5377f08fe7', username='tempest-ServerActionsV293TestJSON-223165141-project-member', projectid='b2f692daeca94508859887b79b6f1ab3', projectname='tempest-ServerActionsV293TestJSON-223165141'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052422.1954074) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:22.197828 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:22.198191 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:22.199369 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:22.199560 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:22.200604 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:22.200870 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:22.201037 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:22.201142 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:22.201280 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:22.201667 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:22.201783 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:22.201973 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:22.202043 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:22.202140 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:22.202248 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:22.202388 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:22.214701 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:20:22.215145 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:22.215295 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:22.249179 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.249553 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:20:22.250459 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid 'a17998b3-c8a4-48e0-b311-b828734699cc' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a17998b3-c8a4-48e0-b311-b828734699cc' (instance-0000000b) Jul 03 04:20:22.252481 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.277774 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:22.313259 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Took 15.64 seconds to build instance. Jul 03 04:20:22.331554 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:20:22.360624 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:22.363038 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:22.366763 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json" returned: 0 in 0.114s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.368290 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.470670 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.471366 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.579510 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.580095 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.679037 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.683379 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.710300 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Successfully updated port: ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:22.715013 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:22.782651 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Received event network-changed-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:22.783528 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Refreshing instance network info cache due to event network-changed-ccf07483-3a98-403c-afaf-a944013884fb. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:22.785822 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] Acquiring lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:22.785822 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] Acquired lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:22.785822 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Refreshing network info cache for port ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:22.789053 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Took 1.81 seconds to deallocate network for instance. Jul 03 04:20:22.796613 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.797134 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:22.828349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f016d834-ee0d-4c42-a8ba-211239a7aa5c tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.181s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:22.853540 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-de753385-dd58-41df-9d91-343ecc33fcf2 req-e0d2ea97-5058-46d6-9d4b-b747a27133db service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-deleted-583fc957-b34a-49b7-b85a-d99dce25a38c {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:22.853763 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-de753385-dd58-41df-9d91-343ecc33fcf2 req-e0d2ea97-5058-46d6-9d4b-b747a27133db service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Neutron deleted interface 583fc957-b34a-49b7-b85a-d99dce25a38c; detaching it from the instance and deleting it from the info cache Jul 03 04:20:22.864571 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-de753385-dd58-41df-9d91-343ecc33fcf2 req-e0d2ea97-5058-46d6-9d4b-b747a27133db service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Detach interface failed, port_id=583fc957-b34a-49b7-b85a-d99dce25a38c, reason: Instance a17998b3-c8a4-48e0-b311-b828734699cc could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:22.866749 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:22.866920 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] VM Started (Lifecycle Event) Jul 03 04:20:22.876229 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:22.876509 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:22.912307 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:22.915784 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.020300 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.020684 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.117399 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.126362 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:23.126843 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid '77cf1107-c221-4469-be55-8d94c590491a' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid '77cf1107-c221-4469-be55-8d94c590491a' (instance-0000000e) Jul 03 04:20:23.127293 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:23.127686 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Creating image(s) Jul 03 04:20:23.128437 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "/opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:23.128718 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:23.129427 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:23.130801 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.131515 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:23.137020 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:23.157420 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.186862 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:23.241978 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:23.244487 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.244898 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.260191 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.102s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.265532 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:23.267245 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:23.269659 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:23.277428 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:23.278901 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.304550 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:23.339877 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.343699 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:20:23.346342 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:23.346342 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.366487 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Found WWN 3300000006e44275e for multipath device dm-4 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:20:23.368535 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.061s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:23.369160 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] <== connect_volume: return (2062ms) {'type': 'block', 'scsi_wwn': '3300000006e44275e', 'path': '/dev/dm-4', 'multipath_id': '3300000006e44275e'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:23.369556 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006e44275e', 'path': '/dev/dm-4', 'multipath_id': '3300000006e44275e'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:20:23.372272 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.094s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.374292 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.158s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:23.375023 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:20:23.376352 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.405592 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:23.406047 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:23.417557 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:23.419313 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:23.419543 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:23.419992 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "env LANG=C uptime" returned: 0 in 0.074s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.420640 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:23.426439 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Took 0.63 seconds to detach 1 volumes for instance. Jul 03 04:20:23.441997 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Hypervisor/Node resource view: name=np0000004364 free_ram=50846MB free_disk=74.11600875854492GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:20:23.441997 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:23.445054 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.010s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:23.448390 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:23.451383 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk 1073741824" returned: 0 in 0.068s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.451383 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Deleting volume: 6b296f6f-1224-4410-a9cb-c26d716e7430 {{(pid=98951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3457}} Jul 03 04:20:23.453307 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:20:23.453307 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:23.453668 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:23.453886 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.188s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:23.454402 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36] added Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:23.474709 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:23.477058 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:20:23.477683 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0578(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:20:23.478289 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:20:23.479222 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:20:23.479222 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:23.497549 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36] added Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:23.500027 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:23.500361 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:20:23.501077 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.055(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:20:23.501355 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:20:23.529560 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updated VIF entry in instance network info cache for port ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:23.529929 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updating instance_info_cache with network_info: [{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:23.557949 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.103s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.558465 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:20:23.559220 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:23.657957 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:23.658406 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Cannot resize image /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:20:23.662409 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:23.662409 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Ensure instance console log exists: /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:23.662409 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:23.662409 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:23.662409 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:23.704729 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:23.839576 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Received event network-vif-deleted-41beed31-04a2-4b95-9152-d62601cbe2fd {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:23.840086 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:23.840338 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] Acquiring lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:23.840585 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:23.841731 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] Lock "a17998b3-c8a4-48e0-b311-b828734699cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:23.842216 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] No waiting events found dispatching network-vif-unplugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:23.842216 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-unplugged-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:23.842348 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:23.845916 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:23.847483 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.005s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:23.847644 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:23.847799 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] No waiting events found dispatching network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:23.848194 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received unexpected event network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 for instance with vm_state building and task_state spawning. Jul 03 04:20:23.848194 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-deleted-c55a7c12-cefb-4547-ab80-3fd1eb3a14c4 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:23.848271 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Neutron deleted interface c55a7c12-cefb-4547-ab80-3fd1eb3a14c4; detaching it from the instance and deleting it from the info cache Jul 03 04:20:23.851793 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-0b8eb761-a0fb-4df0-95ba-73da15760c3a req-28c4e85c-69c5-44b7-bf35-0ac9e6ad2ffd service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Detach interface failed, port_id=c55a7c12-cefb-4547-ab80-3fd1eb3a14c4, reason: Instance a17998b3-c8a4-48e0-b311-b828734699cc could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:23.928215 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-589779902',display_name='tempest-ServerStableDeviceRescueTest-server-589779902',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverstabledevicerescuetest-server-589779902',id=13,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/0M+SZsgUuhYAO8ZEsx9JJuvYP56lAldRqOM6z3mK1R0DTeikdK/ZpA8jv5jBrPjRCnsHJSpGqsSAmJXXGhuJHViZ1dOlN5jrnRcYNIqBz+90MB+7YvXEbLbXllV1M+A==',key_name='tempest-keypair-1663150320',keypairs=,launch_index=0,launched_at=2026-07-03T04:19:12Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='662ad5b7bca441b387156b61f2272bff',ramdisk_id='',reservation_id='r-srwxoga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-645362785',owner_user_name='tempest-ServerStableDeviceRescueTest-645362785-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f382e83c876463dac1650a3f0272ec5',uuid=8797c544-317e-4ae4-9a84-512976e3225f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "vif_mac": "fa:16:3e:ee:b5:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:23.928438 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converting VIF {"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "vif_mac": "fa:16:3e:ee:b5:97"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:23.929420 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:23.930012 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'pci_devices' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:23.934160 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.399s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:23.934601 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:20:23.942041 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.501s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:23.947538 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:23.948209 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] VM Resumed (Lifecycle Event) Jul 03 04:20:24.038528 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Releasing lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:24.038528 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:24.038528 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:24.040065 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:24.040065 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:24.040637 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] No waiting events found dispatching network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:24.040637 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received unexpected event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 for instance with vm_state rescued and task_state None. Jul 03 04:20:24.040637 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:24.040637 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Acquiring lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:24.040845 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:24.040845 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] Lock "b991be57-007c-4b9b-9d28-b80d662100a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:24.041006 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] No waiting events found dispatching network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:24.041456 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-20a56db1-601e-4e99-a1ee-94bbb463a027 req-6e2b48ac-5fc9-4fd3-9a9d-ddae0f91b7e1 service nova] [instance: b991be57-007c-4b9b-9d28-b80d662100a9] Received unexpected event network-vif-plugged-1c4a0dea-a323-4809-9b68-25896065a092 for instance with vm_state rescued and task_state None. Jul 03 04:20:24.044601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:24.117056 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Rescuing Jul 03 04:20:24.117193 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:24.117267 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquired lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:24.117439 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:24.206791 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b4300d13-c2d5-4113-a2bc-fd2ad36e2f53 req-0b473e00-39dd-45ff-9063-6e737c31435e service nova] Releasing lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:24.207446 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquired lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:24.207648 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:24.442810 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:24.455854 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] End _get_guest_xml xml= Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: instance-0000000d Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: tempest-ServerStableDeviceRescueTest-server-589779902 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 2026-07-03 04:20:20 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: True Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: bare Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: ide Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: pc Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: tempest-ServerStableDeviceRescueTest-645362785-project-member Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: tempest-ServerStableDeviceRescueTest-645362785 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: 3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: Jul 03 04:20:24.457718 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:24.461626 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:24.461626 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:20:24.466512 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:24.466944 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:24.473119 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:24.474858 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance destroyed successfully. Jul 03 04:20:24.479964 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:24.496492 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:24.496692 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:24.498338 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.501824 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:24.515217 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:24.520664 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.532932 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.533214 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:24.539595 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.554551 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de4ae2700e8a4e6180b4f7f872b48aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470ce7b097604ff79ffa0835affde06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.561815 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.562081 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:24.584049 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.40.100,3260] Jul 03 04:20:24.584049 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.40.100,3260] successful. Jul 03 04:20:24.584049 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.596521 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.613124 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.50.100,3260] Jul 03 04:20:24.613124 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.50.100,3260] successful. Jul 03 04:20:24.613124 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.619516 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.621981 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.624397 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:24.625318 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:24.625553 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:24.628592 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] HCTL ('13', '-', '-', 0) found on session 37 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:24.628763 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:24.629964 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:24.642926 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 37 and hctl ['13', '*', '*', 0] yield: None {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.651727 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:24.652068 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:24.652435 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:24.652435 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:24.653247 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] HCTL ('14', '-', '-', 0) found on session 38 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:24.653407 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:24.667936 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 38 and hctl ['14', '*', '*', 0] yield: None {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:24.738565 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:24.796280 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:24.827834 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:24.865620 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-88c3f46c-9998-48f8-a9a1-c6f2b3acee52 req-b3dd402f-814b-4155-adc5-f1b9cd950874 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-deleted-252ba38f-fd86-45a7-bde9-bf8990e3b9d8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:24.865620 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-88c3f46c-9998-48f8-a9a1-c6f2b3acee52 req-b3dd402f-814b-4155-adc5-f1b9cd950874 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-deleted-e621f500-6f8f-4957-8211-cc80133cca3f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:24.938656 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1d8c3ab3-c4a8-4807-bf73-f4f5a159d144 req-6a76f6df-162b-4821-82be-c7005d1b7a05 service nova] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Received event network-vif-deleted-f83d6f94-8dc8-4b7b-9ddd-47874b84aa59 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:24.967347 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:25.004022 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:25.009783 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:25.041767 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:25.060967 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b5ee81e7-eef9-4b72-a375-30801621eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.061158 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance fab3fe2f-7444-4177-a9ff-0e9b068efe7c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.061280 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance a17998b3-c8a4-48e0-b311-b828734699cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.061482 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c44b3de1-d811-402b-9852-c5bb063fdcb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 8797c544-317e-4ae4-9a84-512976e3225f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: WARNING nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 77cf1107-c221-4469-be55-8d94c590491a is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do. Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 92676c92-4e10-44e8-be59-269fd72a616e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b991be57-007c-4b9b-9d28-b80d662100a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 763d288c-14bd-4ae1-b6bb-adf487165e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 683d1775-ad4b-4200-9d1d-ef75e6c95064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.062903 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c7760c72-db16-418b-b3b8-84fab8054f20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:20:25.208505 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updating instance_info_cache with network_info: [{"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:25.219338 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Successfully created port: a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:25.244626 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:25.252295 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Updating instance_info_cache with network_info: [{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:25.333649 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Took 4.71 seconds to deallocate network for instance. Jul 03 04:20:25.472879 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:25.563118 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:25.566055 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance a20214c3-5676-4986-83ae-3bbfb7789732 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jul 03 04:20:25.566258 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Total usable vcpus: 16, total allocated vcpus: 13 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:20:25.566461 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=3008MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:20:23 up 28 min, 2 users, load average: 10.49, 5.56, 2.57\n', 'num_instances': '13', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '13', 'num_proj_80f331cd7f014a0eb91a6c479ad14d3f': '3', 'io_workload': '5', 'num_task_rescuing': '2', 'num_proj_662ad5b7bca441b387156b61f2272bff': '1', 'num_proj_f9de1e5af73b486dbece4a569eeaaa68': '3', 'num_proj_82604b4949eb47659d954def4e326795': '2', 'num_vm_rescued': '1', 'num_proj_fc3628de66374638b6a90f8481b23f1a': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_b2f692daeca94508859887b79b6f1ab3': '1', 'num_proj_470ce7b097604ff79ffa0835affde06b': '1', 'num_task_deleting': '1', 'num_proj_9b71dccbd489492bb2cbdb93a1ba716e': '1'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:20:25.643622 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 37 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:25.643927 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:25.668179 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 38 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:25.668731 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:25.711668 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Releasing lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:25.711960 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Instance network_info: |[{"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:25.713708 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Start _get_guest_xml network_info=[{"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:25.717066 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:25.718753 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='337a804b-18df-468c-ae55-d67ca3d7dbd5'), owner=OwnerMeta(userid='18cf98c1da954ad0bdb32a5854b3ba36', username='tempest-AttachVolumeMultiAttachTest-1445524669-project-member', projectid='f9de1e5af73b486dbece4a569eeaaa68', projectname='tempest-AttachVolumeMultiAttachTest-1445524669'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052425.7182198) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:25.720153 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:25.720623 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:25.721612 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:25.721926 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:25.723184 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:25.723639 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:25.723850 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:25.724011 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:25.724196 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:25.724334 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:25.724491 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:25.724694 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:25.724849 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:25.725063 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:25.725171 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:25.725359 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:25.744642 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-1',id=21,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-ay94akgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=337a804b-18df-468c-ae55-d67ca3d7dbd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:25.744935 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:25.745586 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:7f:41,bridge_name='br-int',has_traffic_filtering=True,id=ccf07483-3a98-403c-afaf-a944013884fb,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf07483-3a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:25.746180 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'pci_devices' on Instance uuid 337a804b-18df-468c-ae55-d67ca3d7dbd5 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:25.755067 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Releasing lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:25.803386 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Successfully updated port: a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:26.002183 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:26.007442 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:26.007442 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:26.007442 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:26.007442 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] No VIF found with MAC fa:16:3e:ee:b5:97, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:26.007442 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Using config drive Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] End _get_guest_xml xml= Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 337a804b-18df-468c-ae55-d67ca3d7dbd5 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: instance-00000015 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: multiattach-server-1 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 2026-07-03 04:20:25 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: True Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: bare Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669-project-member Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 337a804b-18df-468c-ae55-d67ca3d7dbd5 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 337a804b-18df-468c-ae55-d67ca3d7dbd5 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: Jul 03 04:20:26.248842 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Preparing to wait for external event network-vif-plugged-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-1',id=21,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-ay94akgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=337a804b-18df-468c-ae55-d67ca3d7dbd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:7f:41,bridge_name='br-int',has_traffic_filtering=True,id=ccf07483-3a98-403c-afaf-a944013884fb,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf07483-3a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:7f:41,bridge_name='br-int',has_traffic_filtering=True,id=ccf07483-3a98-403c-afaf-a944013884fb,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf07483-3a') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:26.251851 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.254656 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:26.258114 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:26.259065 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.259275 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a59b9656-e15b-5872-98cd-875c3bef0514', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:26.260253 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.261131 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:26.269562 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.274748 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.275012 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf07483-3a, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:26.275390 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccf07483-3a, col_values=(('qos', UUID('0645822e-f9da-4241-8ade-a86204a6666a')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:26.275599 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccf07483-3a, col_values=(('external_ids', {'iface-id': 'ccf07483-3a98-403c-afaf-a944013884fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:7f:41', 'vm-uuid': '337a804b-18df-468c-ae55-d67ca3d7dbd5'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:26.291573 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.293289 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:26.301800 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:26.303571 np0000004364 nova-compute[98951]: INFO os_vif [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:7f:41,bridge_name='br-int',has_traffic_filtering=True,id=ccf07483-3a98-403c-afaf-a944013884fb,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf07483-3a') Jul 03 04:20:26.306603 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:26.306739 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquired lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:26.306878 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:26.361515 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:26.361515 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:26.427248 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:20:26.486447 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:26.487470 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:26.487763 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Creating image(s) Jul 03 04:20:26.488268 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:26.488621 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "/opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:26.493541 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "/opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:26.494218 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:26.500574 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:26.501749 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:26.519797 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:26.600839 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.099s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:26.601544 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:26.602021 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:26.602418 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:26.605257 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:26.605772 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:26.699436 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.093s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:26.700036 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:26.752486 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk 1073741824" returned: 0 in 0.052s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:26.753054 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.151s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:26.753506 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:26.830223 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.076s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:26.830631 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:20:26.830920 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:26.866691 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:26.918162 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:26.918489 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Cannot resize image /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:20:26.919230 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:26.919230 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Ensure instance console log exists: /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:26.919230 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:26.919371 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:26.919495 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:26.930518 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:26.935896 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-changed-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:26.936063 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Refreshing instance network info cache due to event network-changed-a1799159-0da5-4283-8742-3e8981f646da. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:26.936223 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] Acquiring lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:27.007469 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Took 1.67 seconds to detach 3 volumes for instance. Jul 03 04:20:27.026172 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:27.026346 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'keypairs' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:27.125451 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:27.277471 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updating instance_info_cache with network_info: [{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:27.384890 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:20:27.384890 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.443s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:27.384890 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.342s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:27.385103 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.00 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:20:27.386565 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:27.388462 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.824s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:27.390847 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:27.391010 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Claim successful on node np0000004364 Jul 03 04:20:27.438413 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:27.458477 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Found WWN 3300000007a01ed40 for multipath device dm-5 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:20:27.459413 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.085s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:27.459413 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] <== connect_volume: return (5243ms) {'type': 'block', 'scsi_wwn': '3300000007a01ed40', 'path': '/dev/dm-5', 'multipath_id': '3300000007a01ed40'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:27.459413 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a01ed40', 'path': '/dev/dm-5', 'multipath_id': '3300000007a01ed40'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:20:27.460764 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Deleted allocations for instance 77cf1107-c221-4469-be55-8d94c590491a Jul 03 04:20:27.467957 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:27.514880 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:27.531256 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:27.539192 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:27.600200 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:27.616051 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:27.641960 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7f3ee318-11a7-46f6-afa5-98e3bc8c6342 req-9459c046-3ca9-4090-805b-7d118ecf89f8 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:27.642810 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7f3ee318-11a7-46f6-afa5-98e3bc8c6342 req-9459c046-3ca9-4090-805b-7d118ecf89f8 service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:27.644063 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7f3ee318-11a7-46f6-afa5-98e3bc8c6342 req-9459c046-3ca9-4090-805b-7d118ecf89f8 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:27.644261 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-7f3ee318-11a7-46f6-afa5-98e3bc8c6342 req-9459c046-3ca9-4090-805b-7d118ecf89f8 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:27.644475 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-7f3ee318-11a7-46f6-afa5-98e3bc8c6342 req-9459c046-3ca9-4090-805b-7d118ecf89f8 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:27.644751 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-7f3ee318-11a7-46f6-afa5-98e3bc8c6342 req-9459c046-3ca9-4090-805b-7d118ecf89f8 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state active and task_state rescuing. Jul 03 04:20:27.686115 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Creating config drive at /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config.rescue Jul 03 04:20:27.691358 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpudns_t__ {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:27.740576 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.9993688940001 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:27.743202 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance destroyed successfully. Jul 03 04:20:27.745217 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:27.758046 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpudns_t__" returned: 0 in 0.067s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:27.780953 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Releasing lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:27.781500 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Instance network_info: |[{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:27.781897 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] Acquired lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:27.782061 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Refreshing network info cache for port a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:27.786280 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Start _get_guest_xml network_info=[{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:27.791246 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:27.793184 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-779117799', uuid='c7760c72-db16-418b-b3b8-84fab8054f20'), owner=OwnerMeta(userid='de4ae2700e8a4e6180b4f7f872b48aa2', username='tempest-TaggedAttachmentsTest-1428503768-project-member', projectid='470ce7b097604ff79ffa0835affde06b', projectname='tempest-TaggedAttachmentsTest-1428503768'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052427.7926319) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:27.795155 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:27.795826 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:27.797576 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:27.798045 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:27.799468 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:27.799961 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:27.800171 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:27.800337 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:27.800555 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:27.800742 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:27.800801 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:27.801007 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:27.801159 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:27.801335 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:27.801515 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:27.801672 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:27.819404 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779117799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-779117799',id=22,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG01GSchcsMSx38ZfTYqg/TH2kuYPxcrMIKUyQQA4dmxeKKXZGEw6So0NOpVy97o7lCf64vPrceOY0K57vXhKJfNsgaQ9RXthAtbaALWl4rLnwB8EHYvJzE9i3Wl/uZwmg==',key_name='tempest-keypair-802072938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='470ce7b097604ff79ffa0835affde06b',ramdisk_id='',reservation_id='r-abhge2jh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1428503768',owner_user_name='tempest-TaggedAttachmentsTest-1428503768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4ae2700e8a4e6180b4f7f872b48aa2',uuid=c7760c72-db16-418b-b3b8-84fab8054f20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:27.819773 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converting VIF {"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:27.820700 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:4c,bridge_name='br-int',has_traffic_filtering=True,id=a1799159-0da5-4283-8742-3e8981f646da,network=Network(6e677b2a-7649-448d-8394-d6fbf9829064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1799159-0d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:27.821458 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'pci_devices' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:27.834878 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:27.835931 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:27.835931 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:85:7f:41, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:27.835931 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Using config drive Jul 03 04:20:27.973581 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-57277548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionsv293testjson-server-57277548',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Yj2Fyp3SZRpYB2rBZZcPbTWonX/mA+GmC/Vc6BAQrNqVpT6Hc4JpMk5blfi1Ue6dV8mzdRfR7qbmKYTn/T3ZLVG/Cu/bFClo+moYfiL66FdO+6nLEszVXzj7+VwYYeA==',key_name='tempest-keypair-209897224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f692daeca94508859887b79b6f1ab3',ramdisk_id='',reservation_id='r-wvzshjlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-223165141',owner_user_name='tempest-ServerActionsV293TestJSON-223165141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca140c204734e4fbf4eda5377f08fe7',uuid=683d1775-ad4b-4200-9d1d-ef75e6c95064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:27.974040 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converting VIF {"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:27.974805 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:27.975818 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lazy-loading 'pci_devices' on Instance uuid 683d1775-ad4b-4200-9d1d-ef75e6c95064 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:28.034798 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004910990001008031 future=) was cancelled during its delay period, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.034985 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.035049 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.5601490540000214 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.035149 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=1.5600430199999664 future=) was cancelled while queued, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.035310 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.035431 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.171395939999911 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.035536 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.171301156000027 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:28.237697 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.250897 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Attempting rescue Jul 03 04:20:28.251654 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98951) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4642}} Jul 03 04:20:28.255956 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance directory exists: not creating {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5219}} Jul 03 04:20:28.256073 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Creating image(s) Jul 03 04:20:28.256697 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:28.256878 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:28.257374 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:28.257565 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:28.280255 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.285621 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] End _get_guest_xml xml= Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: c7760c72-db16-418b-b3b8-84fab8054f20 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: instance-00000016 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: tempest-device-tagging-server-779117799 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 2026-07-03 04:20:27 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: True Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: bare Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: tempest-TaggedAttachmentsTest-1428503768-project-member Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: tempest-TaggedAttachmentsTest-1428503768 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: c7760c72-db16-418b-b3b8-84fab8054f20 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: c7760c72-db16-418b-b3b8-84fab8054f20 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: Jul 03 04:20:28.327637 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Preparing to wait for external event network-vif-plugged-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779117799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-779117799',id=22,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG01GSchcsMSx38ZfTYqg/TH2kuYPxcrMIKUyQQA4dmxeKKXZGEw6So0NOpVy97o7lCf64vPrceOY0K57vXhKJfNsgaQ9RXthAtbaALWl4rLnwB8EHYvJzE9i3Wl/uZwmg==',key_name='tempest-keypair-802072938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='470ce7b097604ff79ffa0835affde06b',ramdisk_id='',reservation_id='r-abhge2jh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1428503768',owner_user_name='tempest-TaggedAttachmentsTest-1428503768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4ae2700e8a4e6180b4f7f872b48aa2',uuid=c7760c72-db16-418b-b3b8-84fab8054f20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converting VIF {"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:4c,bridge_name='br-int',has_traffic_filtering=True,id=a1799159-0da5-4283-8742-3e8981f646da,network=Network(6e677b2a-7649-448d-8394-d6fbf9829064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1799159-0d') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:28.330685 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:4c,bridge_name='br-int',has_traffic_filtering=True,id=a1799159-0da5-4283-8742-3e8981f646da,network=Network(6e677b2a-7649-448d-8394-d6fbf9829064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1799159-0d') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:28.331202 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.331451 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.332569 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:28.334419 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.334626 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1cc0d43-54f8-5064-9c94-e900b7e43b7c', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.335404 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.336081 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:28.348668 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:28.354684 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.362715 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.362715 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1799159-0d, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.362715 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1799159-0d, col_values=(('qos', UUID('fde987b5-c99f-4191-9a5f-30761a74b96e')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.363537 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1799159-0d, col_values=(('external_ids', {'iface-id': 'a1799159-0da5-4283-8742-3e8981f646da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:9f:4c', 'vm-uuid': 'c7760c72-db16-418b-b3b8-84fab8054f20'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.365349 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.367228 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:28.372380 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.392022 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.393077 np0000004364 nova-compute[98951]: INFO os_vif [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9f:4c,bridge_name='br-int',has_traffic_filtering=True,id=a1799159-0da5-4283-8742-3e8981f646da,network=Network(6e677b2a-7649-448d-8394-d6fbf9829064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1799159-0d') Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] End _get_guest_xml xml= Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 683d1775-ad4b-4200-9d1d-ef75e6c95064 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: instance-00000014 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: tempest-ServerActionsV293TestJSON-server-57277548 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 2026-07-03 04:20:22 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: True Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: tempest-ServerActionsV293TestJSON-223165141-project-member Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: tempest-ServerActionsV293TestJSON-223165141 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 683d1775-ad4b-4200-9d1d-ef75e6c95064 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 683d1775-ad4b-4200-9d1d-ef75e6c95064 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: e6ee881b-4344-4a43-8c3c-d21965282d36 Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: Jul 03 04:20:28.481770 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Preparing to wait for external event network-vif-plugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-57277548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionsv293testjson-server-57277548',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Yj2Fyp3SZRpYB2rBZZcPbTWonX/mA+GmC/Vc6BAQrNqVpT6Hc4JpMk5blfi1Ue6dV8mzdRfR7qbmKYTn/T3ZLVG/Cu/bFClo+moYfiL66FdO+6nLEszVXzj7+VwYYeA==',key_name='tempest-keypair-209897224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f692daeca94508859887b79b6f1ab3',ramdisk_id='',reservation_id='r-wvzshjlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-223165141',owner_user_name='tempest-ServerActionsV293TestJSON-223165141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca140c204734e4fbf4eda5377f08fe7',uuid=683d1775-ad4b-4200-9d1d-ef75e6c95064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converting VIF {"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:28.485058 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.486810 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-23bcdcaa-58f5-493e-8c93-23478e11b205 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "77cf1107-c221-4469-be55-8d94c590491a" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.536s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:28.491775 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.495664 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:28.502306 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.502306 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3afc87a5-47f9-52a7-b778-36663b534541', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.502306 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.502746 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:28.548780 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Creating config drive at /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk.config Jul 03 04:20:28.550508 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.555422 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.555697 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccecc6b7-d1, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.555927 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccecc6b7-d1, col_values=(('qos', UUID('bb7021ac-5867-4ca7-94f2-decd296a2ca4')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.556050 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccecc6b7-d1, col_values=(('external_ids', {'iface-id': 'ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:5d:68', 'vm-uuid': '683d1775-ad4b-4200-9d1d-ef75e6c95064'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:28.556824 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.558466 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:28.564027 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoo_taheb {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:28.603956 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.609765 np0000004364 nova-compute[98951]: INFO os_vif [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') Jul 03 04:20:28.625616 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.631967 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoo_taheb" returned: 0 in 0.068s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:28.671485 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.680730 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:28.758528 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:28.761477 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:28.764153 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:28.769818 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:28.769818 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:28.769818 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:28.769818 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:28.773727 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:28.774544 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:28.868796 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.091s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:28.875375 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.rescue {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:28.956159 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.rescue" returned: 0 in 0.081s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:28.958351 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.189s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:28.958351 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'migration_context' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:29.011813 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updated VIF entry in instance network info cache for port a1799159-0da5-4283-8742-3e8981f646da. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:29.012192 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updating instance_info_cache with network_info: [{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:29.109375 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:29.109750 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.110047 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.110148 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:29.113937 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:29.114531 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state rescuing. Jul 03 04:20:29.114757 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:29.114997 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.115180 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.115375 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:29.116270 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:29.117207 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2e5edc78-68e7-4709-94ff-5cfd4debf32e req-df5a5f78-269b-46b1-96ac-54c00996c0c2 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state rescuing. Jul 03 04:20:29.128794 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:29.175087 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:29.178157 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:29.272237 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:29.334028 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:29.340516 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 8797c544-317e-4ae4-9a84-512976e3225f due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:29.340516 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:29.340516 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Resumed (Lifecycle Event) Jul 03 04:20:29.349366 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f45e2597-a2c2-4450-b106-ab9642338e5e tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:29.357694 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:29.460431 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:29.462053 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:29.462053 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Start _get_guest_xml network_info=[{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:92:2d:83"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue={'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:29.462053 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'resources' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:29.519623 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2809b396-265b-4b36-a43f-0a900fd4b2d1 req-e1135670-9e5a-43e9-ab18-1c218840500d service nova] Releasing lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:29.531982 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:29.531982 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:29.566032 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.566221 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.566477 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.566647 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.566776 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:29.569465 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Terminating instance Jul 03 04:20:29.727153 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:29.727894 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.728359 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.728713 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:29.728970 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:29.729160 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state active and task_state rescuing. Jul 03 04:20:29.729349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Received event network-vif-plugged-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:29.729579 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.729774 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.730189 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:29.730552 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Processing event network-vif-plugged-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:29.731020 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Received event network-vif-plugged-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:29.731575 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:29.731889 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:29.732063 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:29.732218 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] No waiting events found dispatching network-vif-plugged-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:29.732410 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-12f240e2-37ea-4b03-8995-2a3cd5fbae4a req-ddcf7a79-a84c-4dd2-ba29-058637a0c0f1 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Received unexpected event network-vif-plugged-ccf07483-3a98-403c-afaf-a944013884fb for instance with vm_state building and task_state spawning. Jul 03 04:20:29.848461 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:29.852832 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:29.926104 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:29.926268 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:29.926434 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No VIF found with MAC fa:16:3e:f3:9f:4c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:29.926992 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Using config drive Jul 03 04:20:29.965534 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:29.970277 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:29.972613 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1126143668', uuid='5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995'), owner=OwnerMeta(userid='af92ec9d358c4fcd997ca5ca9acfe7c3', username='tempest-ServerRescueNegativeTestJSON-764277257-project-member', projectid='82604b4949eb47659d954def4e326795', projectname='tempest-ServerRescueNegativeTestJSON-764277257'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:92:2d:83"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052429.9715555) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:29.976346 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:29.976346 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:29.976984 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:29.977295 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:29.979998 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:29.980309 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:29.980309 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:29.980309 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:29.980711 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:29.980711 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:29.980711 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:29.980711 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:29.980957 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:29.980957 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:29.981067 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:29.981118 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:29.981218 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:30.004267 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:30.006342 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:30.009140 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Instance spawned successfully. Jul 03 04:20:30.009581 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:30.034344 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:30.072630 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:30.122446 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.125566 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.134410 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:30.134410 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:30.134410 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No VIF found with MAC fa:16:3e:93:5d:68, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:30.135051 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Using config drive Jul 03 04:20:30.153749 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.244744 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.296679 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b82bf749-cb41-434d-b0c1-f52be65dd99c req-8dfb1584-1c1e-4671-b633-a13b0fc201db service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-unplugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:30.297346 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b82bf749-cb41-434d-b0c1-f52be65dd99c req-8dfb1584-1c1e-4671-b633-a13b0fc201db service nova] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:30.297586 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b82bf749-cb41-434d-b0c1-f52be65dd99c req-8dfb1584-1c1e-4671-b633-a13b0fc201db service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:30.297723 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b82bf749-cb41-434d-b0c1-f52be65dd99c req-8dfb1584-1c1e-4671-b633-a13b0fc201db service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:30.297878 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b82bf749-cb41-434d-b0c1-f52be65dd99c req-8dfb1584-1c1e-4671-b633-a13b0fc201db service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] No waiting events found dispatching network-vif-unplugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:30.298042 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b82bf749-cb41-434d-b0c1-f52be65dd99c req-8dfb1584-1c1e-4671-b633-a13b0fc201db service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-unplugged-af1aae67-b7a7-4adf-928b-f342e6653627 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:30.340054 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.356996 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:30.356996 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Started (Lifecycle Event) Jul 03 04:20:30.365812 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.420570 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Instance destroyed successfully. Jul 03 04:20:30.421114 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'resources' on Instance uuid c44b3de1-d811-402b-9852-c5bb063fdcb1 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:30.435510 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:30.483386 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:30.495375 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1126143668',display_name='tempest-ServerRescueNegativeTestJSON-server-1126143668',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-1126143668',id=16,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:20:04Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-mgdznc5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:04Z,user_data=None,user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:92:2d:83"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:30.495663 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "vif_mac": "fa:16:3e:92:2d:83"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:30.496259 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:2d:83,bridge_name='br-int',has_traffic_filtering=True,id=c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dd3d62-2f') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:30.497728 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:30.517387 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:30.517596 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:30.517990 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:30.518310 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:30.518651 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:30.518994 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:30.545533 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.159s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:30.546281 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:20:30.552531 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.037s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:30.643040 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:30.648579 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Creating config drive at /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk.config Jul 03 04:20:30.655936 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbw7par2a {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:30.718162 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbw7par2a" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:30.847857 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Creating config drive at /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064/disk.config Jul 03 04:20:30.853732 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0igkzird {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:30.875448 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:30.887863 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:30.924743 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1422264785',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1422264785',id=12,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:19:11Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-tkr9remd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:19:20Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=c44b3de1-d811-402b-9852-c5bb063fdcb1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:30.924743 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "af1aae67-b7a7-4adf-928b-f342e6653627", "address": "fa:16:3e:f2:71:59", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1aae67-b7", "ovs_interfaceid": "af1aae67-b7a7-4adf-928b-f342e6653627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:30.925346 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:30.925659 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:30.927590 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0igkzird" returned: 0 in 0.074s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:30.930701 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.930701 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf1aae67-b7, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:30.932682 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:30.947832 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.949193 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.949460 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67085981-1d5b-4d15-bbfc-643e03eb299d) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:30.952351 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.952351 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:30.968295 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:30.975141 np0000004364 nova-compute[98951]: INFO os_vif [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:71:59,bridge_name='br-int',has_traffic_filtering=True,id=af1aae67-b7a7-4adf-928b-f342e6653627,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1aae67-b7') Jul 03 04:20:30.975738 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Deleting instance files /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1_del Jul 03 04:20:30.977775 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Deletion of /opt/stack/data/nova/instances/c44b3de1-d811-402b-9852-c5bb063fdcb1_del complete Jul 03 04:20:30.999383 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] End _get_guest_xml xml= Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: instance-00000010 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-server-1126143668 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 2026-07-03 04:20:29 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: True Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: bare Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: ide Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: pc Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257-project-member Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: Jul 03 04:20:31.001287 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:31.008711 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance destroyed successfully. Jul 03 04:20:31.028500 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Took 7.90 seconds to spawn the instance on the hypervisor. Jul 03 04:20:31.028703 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:31.061863 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:20:31.062114 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:20:31.062666 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:31.063094 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:31.127736 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Unrescuing Jul 03 04:20:31.128842 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:31.128842 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:31.129239 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:31.175016 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8291a3e27ced4dae9272827563b8f819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3628de66374638b6a90f8481b23f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:20:31.208158 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0012671950000822108 future=) was cancelled during its delay period, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:31.208366 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:31.208366 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.4256477670001004 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:31.208568 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.4254725959999632 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:31.314354 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.359831 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.363285 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.393460 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 03 04:20:31.393852 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:31.394027 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] VM Started (Lifecycle Event) Jul 03 04:20:31.491086 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Took 1.42 seconds to destroy the instance on the hypervisor. Jul 03 04:20:31.492996 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:31.494821 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:31.497415 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:31.497415 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:31.542117 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Took 16.15 seconds to build instance. Jul 03 04:20:31.553055 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.562041 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:31.627150 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:31.627841 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:31.637638 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:31.679085 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:31.750261 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6e044210-bf43-430c-be0a-f80ae436176a req-d65bb25e-632a-47c8-b175-ceb33fa19384 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-vif-plugged-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:31.750632 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6e044210-bf43-430c-be0a-f80ae436176a req-d65bb25e-632a-47c8-b175-ceb33fa19384 service nova] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:31.750880 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6e044210-bf43-430c-be0a-f80ae436176a req-d65bb25e-632a-47c8-b175-ceb33fa19384 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:31.751245 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-6e044210-bf43-430c-be0a-f80ae436176a req-d65bb25e-632a-47c8-b175-ceb33fa19384 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:31.751498 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-6e044210-bf43-430c-be0a-f80ae436176a req-d65bb25e-632a-47c8-b175-ceb33fa19384 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Processing event network-vif-plugged-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:31.757767 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.771125 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.774962 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.808652 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.828154 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.878237 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.880938 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:31.897309 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:31.899742 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:31.940713 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Successfully created port: 4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:31.974453 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:32.044962 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.668s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:32.075403 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:32.131081 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:32.211702 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:32.359031 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:32.369636 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:32.374267 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:32.394777 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-unplugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:32.394869 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] Acquiring lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:32.395048 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:32.397887 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:32.398075 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] No waiting events found dispatching network-vif-unplugged-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:32.398200 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-unplugged-af1aae67-b7a7-4adf-928b-f342e6653627 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:32.398307 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Received event network-vif-deleted-af1aae67-b7a7-4adf-928b-f342e6653627 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:32.398636 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Neutron deleted interface af1aae67-b7a7-4adf-928b-f342e6653627; detaching it from the instance and deleting it from the info cache Jul 03 04:20:32.402819 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:32.402946 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] VM Paused (Lifecycle Event) Jul 03 04:20:32.405580 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:32.407988 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-d348ceec-2d13-4e43-bbe0-90c8e9f4f77e req-8c4b17b2-ff08-43f0-a92f-6ce16fa4fb10 service nova] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Detach interface failed, port_id=af1aae67-b7a7-4adf-928b-f342e6653627, reason: Instance c44b3de1-d811-402b-9852-c5bb063fdcb1 could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:32.412654 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:32.423892 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:32.535591 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:32.535719 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:32.535905 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:32.535978 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No VIF found with MAC fa:16:3e:92:2d:83, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:32.536458 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Using config drive Jul 03 04:20:32.586482 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:32.656997 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.105s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:32.707302 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Successfully updated port: 4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:32.735174 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Deleted allocations for instance a17998b3-c8a4-48e0-b311-b828734699cc Jul 03 04:20:32.791680 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-changed-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:32.791680 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Refreshing instance network info cache due to event network-changed-4d118fbc-6e8e-447c-b8e5-c2e0192340e8. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:32.791680 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] Acquiring lock "refresh_cache-a20214c3-5676-4986-83ae-3bbfb7789732" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:32.793308 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] Acquired lock "refresh_cache-a20214c3-5676-4986-83ae-3bbfb7789732" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:32.793308 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Refreshing network info cache for port 4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:32.835024 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:32.841294 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:32.846062 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Instance spawned successfully. Jul 03 04:20:32.846473 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:32.914055 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:32.920651 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:32.920651 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] VM Resumed (Lifecycle Event) Jul 03 04:20:32.928751 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:32.928751 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'flavor' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:33.041448 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:33.088178 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Took 1.59 seconds to deallocate network for instance. Jul 03 04:20:33.097934 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:33.098929 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:33.099058 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Creating image(s) Jul 03 04:20:33.099677 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "/opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:33.099881 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "/opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:33.100311 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "/opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:33.101048 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:33.105571 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:33.108443 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:33.213968 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "refresh_cache-a20214c3-5676-4986-83ae-3bbfb7789732" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:33.215888 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.109s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:33.216500 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:33.216917 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:33.217432 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:33.223022 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:33.223797 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:33.297470 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:33.338671 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.115s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:33.339204 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:33.369764 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:33.371089 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:33.371541 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:33.371685 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:33.372007 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:33.372320 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:33.381604 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:33.401787 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk 1073741824" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:33.402090 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.185s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:33.402376 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:33.429492 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:33.440550 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:33.475786 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:33.481942 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:33.507856 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:33.509446 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:33.525424 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.123s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:33.527117 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:20:33.527362 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:33.549885 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:33.552065 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:33.556196 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'keypairs' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:33.597247 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:33.597494 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:33.630959 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:33.630959 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Cannot resize image /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:20:33.630959 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:33.630959 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Ensure instance console log exists: /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:33.630959 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:33.632282 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:33.632282 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:33.634298 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000291386000071725 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:33.634432 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:33.634493 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.57700190200012 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:33.634574 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.5769249019999734 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:33.635158 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:33.635399 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] VM Stopped (Lifecycle Event) Jul 03 04:20:33.674090 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Refreshing inventories for resource provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:821}} Jul 03 04:20:33.680510 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:33.752121 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-cb57c6b0-34e6-40ae-aef3-762a50e47b7e tempest-TaggedBootDevicesTest-904864538 tempest-TaggedBootDevicesTest-904864538-project-member] Lock "a17998b3-c8a4-48e0-b311-b828734699cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 17.513s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:33.760975 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Updating ProviderTree inventory for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:785}} Jul 03 04:20:33.761166 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Updating inventory in ProviderTree for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jul 03 04:20:33.824368 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Refreshing aggregate associations for resource provider 1a5251c8-01ca-4243-8d62-6cfdc308a824, aggregates: None {{(pid=98951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:830}} Jul 03 04:20:33.831550 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance destroyed successfully. Jul 03 04:20:33.833412 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'numa_topology' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:33.853814 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-changed-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:33.853814 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing instance network info cache due to event network-changed-37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:33.854420 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:33.854695 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:33.855597 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing network info cache for port 37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:33.884114 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Took 7.40 seconds to spawn the instance on the hypervisor. Jul 03 04:20:33.884114 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:33.896317 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Refreshing trait associations for resource provider 1a5251c8-01ca-4243-8d62-6cfdc308a824, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_PPC64LE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ADDRESS_SPACE_EMULATED,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ARCH_S390X,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_ARCH_MIPSEL,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_AC97,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_VIRTIO_FS {{(pid=98951) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:842}} Jul 03 04:20:33.950294 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99976006099996 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:33.951523 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:33.951523 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] VM Started (Lifecycle Event) Jul 03 04:20:34.064607 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:34.066452 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:34.141320 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: a17998b3-c8a4-48e0-b311-b828734699cc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:34.184151 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-ad9119af-3b57-4142-804e-0cd22b37b62b req-daa89f99-655d-45c2-8ce6-a3b6f713b184 service nova] Releasing lock "refresh_cache-a20214c3-5676-4986-83ae-3bbfb7789732" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:34.184560 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquired lock "refresh_cache-a20214c3-5676-4986-83ae-3bbfb7789732" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:34.185065 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:34.212366 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007821869999133924 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:34.213838 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:34.213912 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.52581007599997 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:34.214000 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.525661143999969 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:34.214534 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:34.214992 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] VM Stopped (Lifecycle Event) Jul 03 04:20:34.238292 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Creating config drive at /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.config.rescue Jul 03 04:20:34.243386 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqcmc7fau {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:34.305088 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqcmc7fau" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:34.337222 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Object Instance<8797c544-317e-4ae4-9a84-512976e3225f> lazy-loaded attributes: flavor,numa_topology {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:34.363218 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:34.401595 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Took 15.63 seconds to build instance. Jul 03 04:20:34.453608 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:34.458099 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:34.721201 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] [instance: 77cf1107-c221-4469-be55-8d94c590491a] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:34.785493 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:34.788498 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:34.792961 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:34.876782 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:34.883764 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:34.883764 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:34.883764 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:34.883764 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:34.884169 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:34.884169 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:34.884356 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:34.884734 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:34.884734 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:34.884968 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:34.884968 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:34.885203 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-c862b5fe-5eaf-4950-a6fe-62466aaed0ee req-c39f3532-c099-46ae-a149-a1942634c092 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-unplugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:34.908947 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1d18c21e-bcdf-4884-ad91-40f9704fdcaa tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.148s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:34.959349 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:34.959747 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] VM Paused (Lifecycle Event) Jul 03 04:20:35.038307 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:35.077167 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updated VIF entry in instance network info cache for port 37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:35.077799 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:35.209115 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.232349 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Updating instance_info_cache with network_info: [{"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:35.252697 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.276230 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:35.276230 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:35.296400 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:35.312194 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-changed-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:35.312767 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Refreshing instance network info cache due to event network-changed-a1799159-0da5-4283-8742-3e8981f646da. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:35.314433 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] Acquiring lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:35.314433 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] Acquired lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:35.314433 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Refreshing network info cache for port a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:35.437235 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.453375 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.465227 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:35.469762 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:35.471060 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] VM Resumed (Lifecycle Event) Jul 03 04:20:35.485503 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.580139 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:35.580538 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-changed-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:35.580538 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing instance network info cache due to event network-changed-37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:35.582094 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:35.582223 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquired lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:35.582644 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Refreshing network info cache for port 37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:35.597466 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.612878 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.616720 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.627783 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.627783 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.654440 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.734110 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Releasing lock "refresh_cache-a20214c3-5676-4986-83ae-3bbfb7789732" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:35.735374 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Instance network_info: |[{"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:35.736755 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Start _get_guest_xml network_info=[{"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:35.751807 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:35.752763 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-349147002', uuid='a20214c3-5676-4986-83ae-3bbfb7789732'), owner=OwnerMeta(userid='8291a3e27ced4dae9272827563b8f819', username='tempest-ServersNegativeTestJSON-77201445-project-member', projectid='fc3628de66374638b6a90f8481b23f1a', projectname='tempest-ServersNegativeTestJSON-77201445'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052435.7523563) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:35.756317 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:35.757096 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:35.759381 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:35.759552 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:35.761539 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:35.761952 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:35.763034 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:35.763034 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:35.763034 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:35.763034 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:35.763034 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:35.763034 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:35.763272 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:35.763272 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:35.764296 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:35.764528 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:35.780067 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'flavor' on Instance uuid b38f9111-bf01-40bd-ae5e-873de4cb90f3 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:35.785583 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-349147002',display_name='tempest-ServersNegativeTestJSON-server-349147002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serversnegativetestjson-server-349147002',id=23,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3628de66374638b6a90f8481b23f1a',ramdisk_id='',reservation_id='r-7r47wsp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-77201445',owner_user_name='tempest-ServersNegativeTestJSON-77201445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:32Z,user_data=None,user_id='8291a3e27ced4dae9272827563b8f819',uuid=a20214c3-5676-4986-83ae-3bbfb7789732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:35.785754 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converting VIF {"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:35.786739 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:35.787161 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lazy-loading 'pci_devices' on Instance uuid a20214c3-5676-4986-83ae-3bbfb7789732 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:35.816367 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.219s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:35.819890 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:35.930126 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Deleted allocations for instance c44b3de1-d811-402b-9852-c5bb063fdcb1 Jul 03 04:20:35.951953 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.951953 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.955351 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:35.974611 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:35.977066 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:36.086877 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:36.228912 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] End _get_guest_xml xml= Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: a20214c3-5676-4986-83ae-3bbfb7789732 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: instance-00000017 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: tempest-ServersNegativeTestJSON-server-349147002 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 2026-07-03 04:20:35 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: True Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: bare Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: tempest-ServersNegativeTestJSON-77201445-project-member Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: tempest-ServersNegativeTestJSON-77201445 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: a20214c3-5676-4986-83ae-3bbfb7789732 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: a20214c3-5676-4986-83ae-3bbfb7789732 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: Jul 03 04:20:36.290584 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:36.295185 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Preparing to wait for external event network-vif-plugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:36.295185 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:36.295185 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:36.295185 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:36.296943 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-349147002',display_name='tempest-ServersNegativeTestJSON-server-349147002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serversnegativetestjson-server-349147002',id=23,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3628de66374638b6a90f8481b23f1a',ramdisk_id='',reservation_id='r-7r47wsp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-77201445',owner_user_name='tempest-ServersNegativeTestJSON-77201445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:32Z,user_data=None,user_id='8291a3e27ced4dae9272827563b8f819',uuid=a20214c3-5676-4986-83ae-3bbfb7789732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:36.296943 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converting VIF {"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:36.296943 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:36.296943 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:36.296943 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:36.297400 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:36.297612 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:36.298853 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:36.298994 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b24ec634-328e-5490-a697-3a9499caefda', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:36.311159 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:36.315945 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:36.327625 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:36.327917 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d118fbc-6e, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:36.328498 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d118fbc-6e, col_values=(('qos', UUID('41fcb854-36c6-4ebc-a02b-895fa37c97ee')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:36.328723 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d118fbc-6e, col_values=(('external_ids', {'iface-id': '4d118fbc-6e8e-447c-b8e5-c2e0192340e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:98:d6', 'vm-uuid': 'a20214c3-5676-4986-83ae-3bbfb7789732'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:36.329778 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:36.330864 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:36.340974 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:36.342144 np0000004364 nova-compute[98951]: INFO os_vif [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') Jul 03 04:20:36.409055 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updated VIF entry in instance network info cache for port a1799159-0da5-4283-8742-3e8981f646da. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:36.409361 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updating instance_info_cache with network_info: [{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:36.457843 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-3bfaf5e1-90c1-4aab-9c30-38c8e1f901d7 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:36.474522 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f057328b-442b-4f50-bb2d-61f8e3133cfc tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:36.482095 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:36.482284 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] VM Started (Lifecycle Event) Jul 03 04:20:36.524028 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:36.721234 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updated VIF entry in instance network info cache for port 37f407be-ae70-442c-8286-abbac76c494d. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:36.722919 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [{"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:36.789543 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:36.912707 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3540ff8c-6329-4593-ad76-390c3c6a9d99 req-9d454c68-5cb4-40fc-a45a-d66e3ba58e00 service nova] Releasing lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:36.940911 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f9a8063d-dd1b-419b-b98d-3eca0cf66d4b tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "c44b3de1-d811-402b-9852-c5bb063fdcb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.374s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:36.978463 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:36.978463 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:36.978463 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:36.978463 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:36.978914 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:36.978914 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state None. Jul 03 04:20:36.978966 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:36.979196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:36.979249 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:36.979403 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:36.981192 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] No waiting events found dispatching network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:36.981192 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-3e8dc557-0b51-4317-a58d-7f1b1eeec9d2 req-5fe9621e-14c9-4643-8dd9-d212f57122d6 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received unexpected event network-vif-plugged-37f407be-ae70-442c-8286-abbac76c494d for instance with vm_state active and task_state None. Jul 03 04:20:36.986033 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:36.988869 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:36.989083 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] VM Paused (Lifecycle Event) Jul 03 04:20:37.223839 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Releasing lock "refresh_cache-8797c544-317e-4ae4-9a84-512976e3225f" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:37.224025 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-vif-plugged-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:37.224263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.224393 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.224521 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:37.224646 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] No waiting events found dispatching network-vif-plugged-a1799159-0da5-4283-8742-3e8981f646da {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:37.224777 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received unexpected event network-vif-plugged-a1799159-0da5-4283-8742-3e8981f646da for instance with vm_state building and task_state spawning. Jul 03 04:20:37.225340 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-vif-plugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:37.225340 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.225340 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.225340 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:37.225340 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Processing event network-vif-plugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:37.225524 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Received event network-changed-19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:37.225524 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Refreshing instance network info cache due to event network-changed-19dc47b6-659a-405b-ae05-e44a65ad0894. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:37.225673 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:37.225763 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquired lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:37.225870 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Refreshing network info cache for port 19dc47b6-659a-405b-ae05-e44a65ad0894 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:37.226821 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:37.229519 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:37.233022 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance spawned successfully. Jul 03 04:20:37.233503 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:37.244342 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.244342 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.244342 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.244342 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.244713 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:37.246539 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Terminating instance Jul 03 04:20:37.377530 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:37.377745 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.377921 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.378047 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:37.378238 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:37.378931 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state rescued and task_state None. Jul 03 04:20:37.379263 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:37.379503 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.379748 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.379930 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:37.380780 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:37.381449 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-f79d2825-7780-4b89-bbb5-5e35f0fa04be req-f7cca40c-167a-463c-8054-22a03be1713a service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state rescued and task_state None. Jul 03 04:20:37.491870 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:37.494062 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999762886000099 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:37.494375 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:37.494509 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:37.494755 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Resumed (Lifecycle Event) Jul 03 04:20:37.731359 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:37.740819 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:37.741012 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:37.741303 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:37.741567 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:37.742180 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:37.742401 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:37.752693 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:37.801998 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:37.811178 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:37.835584 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:37.867883 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:37.868020 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:37.868089 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] No VIF found with MAC fa:16:3e:81:98:d6, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:37.868616 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Using config drive Jul 03 04:20:37.907126 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:37.908670 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:37.908897 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Attaching volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 to /dev/vdb Jul 03 04:20:37.993131 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:37.997183 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:38.002462 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:38.011242 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:20:38.025174 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.028349 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8dfec6ff-6c6a-45da-80a0-330d123c4da1 req-12396b91-ce98-4cd8-9b90-565de769726b service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:38.028972 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8dfec6ff-6c6a-45da-80a0-330d123c4da1 req-12396b91-ce98-4cd8-9b90-565de769726b service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:38.029367 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8dfec6ff-6c6a-45da-80a0-330d123c4da1 req-12396b91-ce98-4cd8-9b90-565de769726b service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:38.029649 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8dfec6ff-6c6a-45da-80a0-330d123c4da1 req-12396b91-ce98-4cd8-9b90-565de769726b service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:38.029872 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8dfec6ff-6c6a-45da-80a0-330d123c4da1 req-12396b91-ce98-4cd8-9b90-565de769726b service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:38.030098 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8dfec6ff-6c6a-45da-80a0-330d123c4da1 req-12396b91-ce98-4cd8-9b90-565de769726b service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:38.036646 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.047361 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:38.109912 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.109912 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:20:38.109912 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:20:38.128385 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.131951 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:20:38.134535 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fe63:83c8', 'fe80::f8d7:18ff:fe31:7f', 'fe80::fc16:3eff:fea6:74be', 'fe80::483:4eff:fe06:c0d8', 'fe80::c95:f2ff:fea6:c330', 'fe80::fc16:3eff:fe42:305c', 'fe80::fc16:3eff:fedc:1a7a', 'fe80::a871:1ff:fe80:4c64', 'fe80::fc16:3eff:fe83:2099', 'fe80::fc16:3eff:fe85:7f41', 'fe80::fc16:3eff:fef3:9f4c', 'fe80::cc6:76ff:fe4d:caf7', 'fe80::fc16:3eff:fe93:5d68', 'fe80::c85d:c2ff:fec4:fd31', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030', 'fe80::fc16:3eff:fe92:2d83'] Jul 03 04:20:38.134744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:20:38.134744 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:20:38.135029 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:38.135269 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updating existing volume attachment record: c361fe5c-b37b-4838-9af6-52b05fb16f47 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:20:38.143097 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Instance destroyed successfully. Jul 03 04:20:38.143848 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'resources' on Instance uuid fab3fe2f-7444-4177-a9ff-0e9b068efe7c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:38.251226 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Took 16.50 seconds to spawn the instance on the hypervisor. Jul 03 04:20:38.251226 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:38.279170 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:38.380377 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:38.387769 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Unrescuing Jul 03 04:20:38.388128 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:38.388215 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquired lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:38.388314 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:38.505540 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 03 04:20:38.506004 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:38.506082 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Started (Lifecycle Event) Jul 03 04:20:38.515233 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updated VIF entry in instance network info cache for port 19dc47b6-659a-405b-ae05-e44a65ad0894. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:38.515875 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Updating instance_info_cache with network_info: [{"id": "19dc47b6-659a-405b-ae05-e44a65ad0894", "address": "fa:16:3e:42:30:5c", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19dc47b6-65", "ovs_interfaceid": "19dc47b6-659a-405b-ae05-e44a65ad0894", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:38.559839 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Creating config drive at /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk.config Jul 03 04:20:38.565503 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9cvk1cm2 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:38.617795 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9cvk1cm2" returned: 0 in 0.052s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:38.650755 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1980795871',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1980795871',id=10,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:18:45Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-s0ffab9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:52Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=fab3fe2f-7444-4177-a9ff-0e9b068efe7c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:38.651018 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "e1167715-3458-4533-88b3-e75cdc67cc48", "address": "fa:16:3e:e7:c0:dc", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1167715-34", "ovs_interfaceid": "e1167715-3458-4533-88b3-e75cdc67cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:38.652039 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:38.652351 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:38.654639 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.654639 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1167715-34, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:38.656280 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.657258 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:38.664699 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.666074 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.666874 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=845f1ac6-5c5c-43ce-b612-875c09b19c29) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:38.668118 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.668118 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:38.674561 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:38.677429 np0000004364 nova-compute[98951]: INFO os_vif [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:dc,bridge_name='br-int',has_traffic_filtering=True,id=e1167715-3458-4533-88b3-e75cdc67cc48,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1167715-34') Jul 03 04:20:38.679076 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:20:38.679499 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:38.679676 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:38.680132 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:38.680717 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcb76750-01eb-4c87-981b-f0879455c8bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:20:38.680943 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:38.712990 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd (non-flash) Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:20:38.713526 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '4')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:38.714975 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd', '3')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:20:38.716206 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Resulting device map defaultdict(. at 0x76c4504ea7a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'): ({'sdb'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:20:38.716206 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Removing multipathed devices sdc, sdb {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:20:38.716206 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Flush multipath device 33000000040a09d61 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:20:38.726883 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:20:38.727149 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:38.727423 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:38.749096 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:38.764341 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Took 24.31 seconds to build instance. Jul 03 04:20:38.793339 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:20:38.840767 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:20:38.840982 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:20:38.843154 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:20:38.859143 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:20:38.859421 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:20:38.874497 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:38.892658 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:38.915590 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.40.100,3260] Jul 03 04:20:38.915590 np0000004364 nova-compute[98951]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.40.100,3260] successful. Jul 03 04:20:38.915590 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:38.936921 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:38.951885 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.004552 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.50.100,3260] Jul 03 04:20:39.004552 np0000004364 nova-compute[98951]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-bcb76750-01eb-4c87-981b-f0879455c8bd, portal: 192.168.50.100,3260] successful. Jul 03 04:20:39.004552 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.009767 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:39.014141 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:39.017989 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Releasing lock "refresh_cache-b38f9111-bf01-40bd-ae5e-873de4cb90f3" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:39.018169 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Received event network-changed-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:39.018338 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Refreshing instance network info cache due to event network-changed-ccf07483-3a98-403c-afaf-a944013884fb. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:39.018616 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:39.019817 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquired lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:39.019817 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Refreshing network info cache for port ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:39.023978 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.024213 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:39.024368 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] <== disconnect_volume: return (344ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:39.024506 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:20:39.024869 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Deleting instance files /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c_del Jul 03 04:20:39.025409 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Deletion of /opt/stack/data/nova/instances/fab3fe2f-7444-4177-a9ff-0e9b068efe7c_del complete Jul 03 04:20:39.029394 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.302s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:39.029706 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:20:39.045525 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:39.046397 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:39.046974 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:39.047374 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:39.047459 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:39.047777 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:39.064427 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:20:39.064427 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.074826 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:20:39.074826 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641] added Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:39.076596 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.076840 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:20:39.077081 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:20:39.077232 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641] added Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:20:39.088488 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:39.089345 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:20:39.089345 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0417(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:20:39.089345 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:20:39.134935 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:39.168851 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:39.172752 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:39.259903 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:39.270102 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b5383894-7348-4772-a161-a6105b4c3e1c tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 25.825s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:39.351357 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:39.351357 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:39.385946 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:39.521121 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:39.524051 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] During sync_power_state the instance has a pending task (unrescuing). Skip. Jul 03 04:20:39.525841 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 8797c544-317e-4ae4-9a84-512976e3225f due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:39.526210 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:39.529835 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Resumed (Lifecycle Event) Jul 03 04:20:39.537726 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Took 1.78 seconds to destroy the instance on the hypervisor. Jul 03 04:20:39.538510 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:39.538655 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:39.538721 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:39.538972 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:39.649043 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Updating instance_info_cache with network_info: [{"id": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "address": "fa:16:3e:92:2d:83", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dd3d62-2f", "ovs_interfaceid": "c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:39.755909 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:40.032220 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:40.063871 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:40.078636 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:40.091852 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:40.110233 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:40.117091 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.136769 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.142217 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.154561 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:40.158909 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Releasing lock "refresh_cache-5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:40.159471 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'flavor' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:40.167465 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-49590fff-abaa-4686-a0db-7043ded8b3fa req-65592a72-5c17-45e5-8019-9fe15a19862c service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-deleted-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:40.167465 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-49590fff-abaa-4686-a0db-7043ded8b3fa req-65592a72-5c17-45e5-8019-9fe15a19862c service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Neutron deleted interface e1167715-3458-4533-88b3-e75cdc67cc48; detaching it from the instance and deleting it from the info cache Jul 03 04:20:40.167465 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-49590fff-abaa-4686-a0db-7043ded8b3fa req-65592a72-5c17-45e5-8019-9fe15a19862c service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Detach interface failed, port_id=e1167715-3458-4533-88b3-e75cdc67cc48, reason: Instance fab3fe2f-7444-4177-a9ff-0e9b068efe7c could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Acquiring lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] No waiting events found dispatching network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Received event network-vif-unplugged-e1167715-3458-4533-88b3-e75cdc67cc48 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-plugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Processing event network-vif-plugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:20:40.178007 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-plugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:40.178462 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:40.178538 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:40.178877 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:40.179400 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] No waiting events found dispatching network-vif-plugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-f56b5646-d74c-460c-913a-4c265b9bfeac req-5b969aa8-491e-4b2a-b393-32d1457cd6ef service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received unexpected event network-vif-plugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 for instance with vm_state building and task_state spawning. Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.181404 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.183662 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.183912 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:40.242678 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.40.100,3260] Jul 03 04:20:40.242678 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.40.100,3260] successful. Jul 03 04:20:40.242678 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.258766 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.50.100,3260] Jul 03 04:20:40.258766 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.50.100,3260] successful. Jul 03 04:20:40.258766 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.273480 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:40.284994 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.289760 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.316596 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:40.317152 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.270s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:40.317152 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.317576 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:40.317895 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.271s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:40.318167 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:40.318748 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] HCTL ('8', '-', '-', 0) found on session 40 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:40.318888 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:40.322060 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] HCTL ('7', '-', '-', 0) found on session 39 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:40.322135 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:40.326037 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:20:40.333931 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:20:40.337234 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Instance spawned successfully. Jul 03 04:20:40.337977 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:20:40.346611 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching for a device in session 40 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:40.346762 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:40.356006 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching for a device in session 39 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:40.356161 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:40.410124 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updated VIF entry in instance network info cache for port ccf07483-3a98-403c-afaf-a944013884fb. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:40.411864 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updating instance_info_cache with network_info: [{"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:40.567869 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:40.568051 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Started (Lifecycle Event) Jul 03 04:20:40.581600 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:40.696265 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:40.703279 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:40.726192 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:40.845312 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:40.845490 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:40.845767 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:40.845976 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:40.846255 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:40.846539 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:20:40.892556 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:40.899315 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Releasing lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-vif-plugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] No waiting events found dispatching network-vif-plugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:40.916260 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-b41686e3-8bfa-478e-b0b7-eb0f33e20360 req-96ccb53d-42b1-43e1-88de-d84198b11d57 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received unexpected event network-vif-plugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 for instance with vm_state building and task_state spawning. Jul 03 04:20:41.035257 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Instance destroyed successfully. Jul 03 04:20:41.035696 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:41.047052 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:20:41.075322 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:41.077137 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:41.085841 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Took 1.55 seconds to deallocate network for instance. Jul 03 04:20:41.352139 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Took 8.25 seconds to spawn the instance on the hypervisor. Jul 03 04:20:41.356414 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:41.537446 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Object Instance<5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995> lazy-loaded attributes: flavor,numa_topology {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:20:41.579834 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:41.579974 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] VM Resumed (Lifecycle Event) Jul 03 04:20:41.662351 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Took 0.58 seconds to detach 1 volumes for instance. Jul 03 04:20:41.664034 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Deleting volume: bcb76750-01eb-4c87-981b-f0879455c8bd {{(pid=98951) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3457}} Jul 03 04:20:41.869365 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Took 16.36 seconds to build instance. Jul 03 04:20:41.990741 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.025046 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.031581 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.069367 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found WWN 330000000df5dddca for multipath device dm-0 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:20:42.069367 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:42.069367 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== connect_volume: return (3341ms) {'type': 'block', 'scsi_wwn': '330000000df5dddca', 'path': '/dev/dm-0', 'multipath_id': '330000000df5dddca'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:42.069367 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000df5dddca', 'path': '/dev/dm-0', 'multipath_id': '330000000df5dddca'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:20:42.075233 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'flavor' on Instance uuid b38f9111-bf01-40bd-ae5e-873de4cb90f3 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:42.086847 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:42.103387 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:42.144300 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.214653 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:42.214653 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:42.227520 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.252196 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.253691 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:42.256940 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:42.257416 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:42.257601 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:42.257749 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:42.257882 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:42.258011 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:42.258129 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:42.258238 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:42.258380 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:42.258489 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:42.259220 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:42.259357 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-2f89467a-a686-4e1c-9acd-3cbcf250765e req-64e7913d-deb4-472e-9f66-dd25600a2bac service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-unplugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state rescued and task_state unrescuing. Jul 03 04:20:42.288677 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-changed-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:42.289006 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Refreshing instance network info cache due to event network-changed-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:42.289816 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] Acquiring lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:42.289816 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] Acquired lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:42.293004 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Refreshing network info cache for port ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:42.370030 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.873s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:42.587914 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Attempting to attach volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] attach device xml: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: Jul 03 04:20:42.595721 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:20:42.608839 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999662581999928 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:42.609174 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:42.609174 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] VM Started (Lifecycle Event) Jul 03 04:20:42.740738 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010317750000012893 future=) was cancelled during its delay period, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:42.740891 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:42.741013 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.209044807999817 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:42.741068 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=6.208947078999927 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:42.800609 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:43.052955 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:43.053242 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:43.087068 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:43.087579 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:43.087579 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:43.087696 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:43.087859 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:43.092930 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Terminating instance Jul 03 04:20:43.115068 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:43.120235 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:43.127524 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-f39e0028-740b-450f-8e6c-93ec51da7aa2 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:43.200007 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:43.408038 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updated VIF entry in instance network info cache for port ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:20:43.408446 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updating instance_info_cache with network_info: [{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:43.556175 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:43.598643 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:43.621739 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] During sync_power_state the instance has a pending task (deleting). Skip. Jul 03 04:20:43.621886 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:43.621946 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] VM Paused (Lifecycle Event) Jul 03 04:20:43.624240 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:43.628437 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:43.652204 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:43.667677 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:43.818899 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:43.828152 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:43.910614 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-42c36f6d-c182-4cd8-ae29-3ede8677338a req-6e76d55c-f78e-4d5c-a081-6f5a1aec807a service nova] Releasing lock "refresh_cache-683d1775-ad4b-4200-9d1d-ef75e6c95064" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:43.964485 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Instance destroyed successfully. Jul 03 04:20:43.965386 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lazy-loading 'resources' on Instance uuid a20214c3-5676-4986-83ae-3bbfb7789732 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:44.065585 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.852s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:44.128981 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:44.133514 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:44.133711 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] VM Resumed (Lifecycle Event) Jul 03 04:20:44.157354 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Deleted allocations for instance fab3fe2f-7444-4177-a9ff-0e9b068efe7c Jul 03 04:20:44.312477 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:44.312601 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:44.312702 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:44.313565 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:42:30:5c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:44.354086 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:44.354086 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:44.354312 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:44.354427 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:44.354546 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:44.354958 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state active and task_state None. Jul 03 04:20:44.354958 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:44.354958 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] Acquiring lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:44.355480 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:44.355480 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] Lock "5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:44.355480 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] No waiting events found dispatching network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:44.355622 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-e6b674d1-e73c-4f5c-8f48-6618b220df43 req-5b2cfebe-f870-4795-ba52-531425d406cd service nova] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Received unexpected event network-vif-plugged-c6dd3d62-2fdb-432e-b7ef-ba58f4ff18f7 for instance with vm_state active and task_state None. Jul 03 04:20:44.382672 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e5ef2531-ade4-47ce-9c1e-e91531bbdfe1 req-4c7ae4e7-7ba4-46db-a001-dad8d1c42603 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-unplugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:44.383597 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e5ef2531-ade4-47ce-9c1e-e91531bbdfe1 req-4c7ae4e7-7ba4-46db-a001-dad8d1c42603 service nova] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:44.383895 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e5ef2531-ade4-47ce-9c1e-e91531bbdfe1 req-4c7ae4e7-7ba4-46db-a001-dad8d1c42603 service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:44.384151 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e5ef2531-ade4-47ce-9c1e-e91531bbdfe1 req-4c7ae4e7-7ba4-46db-a001-dad8d1c42603 service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:44.384481 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e5ef2531-ade4-47ce-9c1e-e91531bbdfe1 req-4c7ae4e7-7ba4-46db-a001-dad8d1c42603 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] No waiting events found dispatching network-vif-unplugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:44.384690 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e5ef2531-ade4-47ce-9c1e-e91531bbdfe1 req-4c7ae4e7-7ba4-46db-a001-dad8d1c42603 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-unplugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:44.467815 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-349147002',display_name='tempest-ServersNegativeTestJSON-server-349147002',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serversnegativetestjson-server-349147002',id=23,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:20:41Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='fc3628de66374638b6a90f8481b23f1a',ramdisk_id='',reservation_id='r-7r47wsp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-77201445',owner_user_name='tempest-ServersNegativeTestJSON-77201445-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:41Z,user_data=None,user_id='8291a3e27ced4dae9272827563b8f819',uuid=a20214c3-5676-4986-83ae-3bbfb7789732,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:44.468813 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converting VIF {"id": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "address": "fa:16:3e:81:98:d6", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d118fbc-6e", "ovs_interfaceid": "4d118fbc-6e8e-447c-b8e5-c2e0192340e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:44.469558 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:44.470202 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:44.471856 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:44.472249 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d118fbc-6e, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:44.473563 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:44.474678 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:44.477892 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:44.478175 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41fcb854-36c6-4ebc-a02b-895fa37c97ee) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:44.479405 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:44.480338 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:44.480860 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:44.483343 np0000004364 nova-compute[98951]: INFO os_vif [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:98:d6,bridge_name='br-int',has_traffic_filtering=True,id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d118fbc-6e') Jul 03 04:20:44.484050 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Deleting instance files /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732_del Jul 03 04:20:44.487054 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Deletion of /opt/stack/data/nova/instances/a20214c3-5676-4986-83ae-3bbfb7789732_del complete Jul 03 04:20:44.638777 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:44.641884 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999746726000012 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:44.641884 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Removed pending STOPPED event for 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 due to new event Resumed> {{(pid=98951) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jul 03 04:20:44.642538 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:44.642538 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Resumed (Lifecycle Event) Jul 03 04:20:44.783116 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:44.993409 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Took 1.39 seconds to destroy the instance on the hypervisor. Jul 03 04:20:44.994094 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:44.994874 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:44.994874 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:44.995122 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:45.064256 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:45.147056 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:45.151397 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:45.167515 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-ce69faa9-1203-43c1-b9be-0ba365096bc3 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "fab3fe2f-7444-4177-a9ff-0e9b068efe7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.924s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:45.276625 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:45.444714 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-08d823e7-1512-4142-acad-575ab0edea0a req-010f0789-fce9-4b17-b04a-b0cee22d6c76 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-deleted-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:45.445520 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-08d823e7-1512-4142-acad-575ab0edea0a req-010f0789-fce9-4b17-b04a-b0cee22d6c76 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Neutron deleted interface 4d118fbc-6e8e-447c-b8e5-c2e0192340e8; detaching it from the instance and deleting it from the info cache Jul 03 04:20:45.446922 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-08d823e7-1512-4142-acad-575ab0edea0a req-010f0789-fce9-4b17-b04a-b0cee22d6c76 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Detach interface failed, port_id=4d118fbc-6e8e-447c-b8e5-c2e0192340e8, reason: Instance a20214c3-5676-4986-83ae-3bbfb7789732 could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:45.652825 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:45.653984 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] VM Started (Lifecycle Event) Jul 03 04:20:45.880503 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:45.911584 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-8da9a9b2-0549-47fc-989c-1db87ac42213 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:46.159362 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:46.162315 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:20:46.382229 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Took 1.39 seconds to deallocate network for instance. Jul 03 04:20:46.393406 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:46.393935 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:46.464833 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-eb2fdd1d-718d-4564-84be-c15950c83753 req-f6d2841e-4cbb-4807-aecb-379da43e8e08 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-unplugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:46.464833 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-eb2fdd1d-718d-4564-84be-c15950c83753 req-f6d2841e-4cbb-4807-aecb-379da43e8e08 service nova] Acquiring lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:46.464833 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-eb2fdd1d-718d-4564-84be-c15950c83753 req-f6d2841e-4cbb-4807-aecb-379da43e8e08 service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:46.464833 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-eb2fdd1d-718d-4564-84be-c15950c83753 req-f6d2841e-4cbb-4807-aecb-379da43e8e08 service nova] Lock "a20214c3-5676-4986-83ae-3bbfb7789732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:46.464833 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-eb2fdd1d-718d-4564-84be-c15950c83753 req-f6d2841e-4cbb-4807-aecb-379da43e8e08 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] No waiting events found dispatching network-vif-unplugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:46.464833 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-eb2fdd1d-718d-4564-84be-c15950c83753 req-f6d2841e-4cbb-4807-aecb-379da43e8e08 service nova] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Received event network-vif-unplugged-4d118fbc-6e8e-447c-b8e5-c2e0192340e8 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:46.638338 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:46.638626 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:46.638846 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:46.639047 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:46.639167 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:46.641662 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Terminating instance Jul 03 04:20:46.665911 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999551669000084 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:46.890717 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:46.890945 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:46.900926 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'flavor' on Instance uuid 337a804b-18df-468c-ae55-d67ca3d7dbd5 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:47.144805 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:47.171492 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.177556 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.205948 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.231113 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.237526 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.418250 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e834d33a-44aa-436a-813a-c157f586b92a req-787ebb43-99e2-4042-baac-e2c34c9164b6 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:47.418517 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e834d33a-44aa-436a-813a-c157f586b92a req-787ebb43-99e2-4042-baac-e2c34c9164b6 service nova] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:47.418744 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e834d33a-44aa-436a-813a-c157f586b92a req-787ebb43-99e2-4042-baac-e2c34c9164b6 service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:47.418911 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e834d33a-44aa-436a-813a-c157f586b92a req-787ebb43-99e2-4042-baac-e2c34c9164b6 service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:47.421283 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e834d33a-44aa-436a-813a-c157f586b92a req-787ebb43-99e2-4042-baac-e2c34c9164b6 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] No waiting events found dispatching network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:47.422125 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e834d33a-44aa-436a-813a-c157f586b92a req-787ebb43-99e2-4042-baac-e2c34c9164b6 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:47.478231 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.486946 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:47.514560 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999658023999928 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:47.516148 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Instance destroyed successfully. Jul 03 04:20:47.516616 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lazy-loading 'resources' on Instance uuid b5ee81e7-eef9-4b72-a375-30801621eafc {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:47.627013 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:47.627281 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:47.910370 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:48.018972 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1299959151',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverbootfromvolumestablerescuetest-server-1299959151',id=1,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:17:51Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='80f331cd7f014a0eb91a6c479ad14d3f',ramdisk_id='',reservation_id='r-e90ft49j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:18:02Z,user_data=None,user_id='4937ea515754406fa0fc0d376433084d',uuid=b5ee81e7-eef9-4b72-a375-30801621eafc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:48.019220 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converting VIF {"id": "aff4956b-4a68-43c4-a12b-82169530ade7", "address": "fa:16:3e:63:83:c8", "network": {"id": "da61db7c-6529-42b8-b5e7-7726c3487f27", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-575676563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80f331cd7f014a0eb91a6c479ad14d3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaff4956b-4a", "ovs_interfaceid": "aff4956b-4a68-43c4-a12b-82169530ade7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:48.019670 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:48.019900 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:48.021682 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:48.022571 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaff4956b-4a, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:48.028036 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:48.029174 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:48.029424 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09e4aa52-fd09-4518-8f4e-55a60fb425d6) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:48.032267 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:48.035880 np0000004364 nova-compute[98951]: INFO os_vif [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:c8,bridge_name='br-int',has_traffic_filtering=True,id=aff4956b-4a68-43c4-a12b-82169530ade7,network=Network(da61db7c-6529-42b8-b5e7-7726c3487f27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaff4956b-4a') Jul 03 04:20:48.036162 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Deleting instance files /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc_del Jul 03 04:20:48.038371 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Deletion of /opt/stack/data/nova/instances/b5ee81e7-eef9-4b72-a375-30801621eafc_del complete Jul 03 04:20:48.132782 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:48.545281 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Took 1.40 seconds to destroy the instance on the hypervisor. Jul 03 04:20:48.545943 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:48.546195 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:48.546252 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:48.546511 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:48.775688 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.885s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:48.798957 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:48.897797 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Deleted allocations for instance a20214c3-5676-4986-83ae-3bbfb7789732 Jul 03 04:20:48.951853 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0017685469999833003 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.952012 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.953213 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.541761528000052 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.953847 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=3.5403481809998993 future=) was cancelled while queued, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.953847 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.953847 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.654694634999942 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.953847 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.654610171000058 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:48.954200 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:48.954314 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] VM Stopped (Lifecycle Event) Jul 03 04:20:49.076275 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:49.076275 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:49.076486 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Attaching volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 to /dev/vdb Jul 03 04:20:49.114720 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "047087f9-9dc6-43a6-a27b-027548780341" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:49.114936 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "047087f9-9dc6-43a6-a27b-027548780341" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:49.151977 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:49.168558 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:20:49.201558 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:49.230308 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-79562405-a201-45fa-8286-092511f1c27e req-60470ffb-7f6e-433f-a1e6-102948bd9f41 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-deleted-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:49.230736 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-79562405-a201-45fa-8286-092511f1c27e req-60470ffb-7f6e-433f-a1e6-102948bd9f41 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Neutron deleted interface aff4956b-4a68-43c4-a12b-82169530ade7; detaching it from the instance and deleting it from the info cache Jul 03 04:20:49.234703 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-79562405-a201-45fa-8286-092511f1c27e req-60470ffb-7f6e-433f-a1e6-102948bd9f41 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Detach interface failed, port_id=aff4956b-4a68-43c4-a12b-82169530ade7, reason: Instance b5ee81e7-eef9-4b72-a375-30801621eafc could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:49.249926 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:20:49.250772 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:20:49.261612 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:20:49.263879 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fea6:74be', 'fe80::483:4eff:fe06:c0d8', 'fe80::c95:f2ff:fea6:c330', 'fe80::fc16:3eff:fe42:305c', 'fe80::fc16:3eff:fedc:1a7a', 'fe80::a871:1ff:fe80:4c64', 'fe80::fc16:3eff:fe83:2099', 'fe80::fc16:3eff:fe85:7f41', 'fe80::fc16:3eff:fef3:9f4c', 'fe80::cc6:76ff:fe4d:caf7', 'fe80::fc16:3eff:fe93:5d68', 'fe80::c85d:c2ff:fec4:fd31', 'fe80::fc16:3eff:feee:b597', 'fe80::c0e:74ff:fe99:5030', 'fe80::fc16:3eff:fe92:2d83'] Jul 03 04:20:49.264313 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:20:49.264913 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:20:49.265484 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:49.265660 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updating existing volume attachment record: 50f49840-8e35-4409-8b3b-58244b7acfe4 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:20:49.460258 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-429bfeb4-5570-449a-823d-8fa7cc6b2add tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] [instance: c44b3de1-d811-402b-9852-c5bb063fdcb1] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:49.529174 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-428dd5a6-b09e-4159-840b-ef02a0679a97 req-8bdc62a7-4076-42d2-97fe-d7232eea6787 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:49.529174 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-428dd5a6-b09e-4159-840b-ef02a0679a97 req-8bdc62a7-4076-42d2-97fe-d7232eea6787 service nova] Acquiring lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:49.529174 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-428dd5a6-b09e-4159-840b-ef02a0679a97 req-8bdc62a7-4076-42d2-97fe-d7232eea6787 service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:49.529174 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-428dd5a6-b09e-4159-840b-ef02a0679a97 req-8bdc62a7-4076-42d2-97fe-d7232eea6787 service nova] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:49.529174 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-428dd5a6-b09e-4159-840b-ef02a0679a97 req-8bdc62a7-4076-42d2-97fe-d7232eea6787 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] No waiting events found dispatching network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:20:49.529174 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-428dd5a6-b09e-4159-840b-ef02a0679a97 req-8bdc62a7-4076-42d2-97fe-d7232eea6787 service nova] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Received event network-vif-unplugged-aff4956b-4a68-43c4-a12b-82169530ade7 for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:20:49.618284 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:49.656593 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:49.833596 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:20:49.834036 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:20:49.834247 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:49.834752 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:49.835060 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:20:49.849137 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:49.849599 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:20:49.850273 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:49.850687 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:20:49.850874 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:20:49.851431 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:49.871147 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.startup = automatic Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.scan = manual Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:20:49.878818 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:49.886909 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:49.895864 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:20:49.909292 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-0920e2f0-7449-45d8-a990-3eb0481eb53f tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "a20214c3-5676-4986-83ae-3bbfb7789732" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.822s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.910590 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.910942 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:49.911434 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:49.911914 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:49.912718 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] HCTL ('8', '0', '0', 0) found on session 40 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:49.912885 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.919725 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:20:49.920123 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:20:49.920394 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.070s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:49.920394 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:20:49.921872 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] HCTL ('7', '0', '0', 0) found on session 39 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:20:49.922338 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:20:49.926505 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching for a device in session 40 and hctl ('8', '0', '0', 0) yield: sdb {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:49.926505 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:49.933348 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching for a device in session 39 and hctl ('7', '0', '0', 0) yield: sdc {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:20:49.933812 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:20:50.160044 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Took 1.61 seconds to deallocate network for instance. Jul 03 04:20:50.180401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:50.180401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:50.184174 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:50.184940 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Claim successful on node np0000004364 Jul 03 04:20:50.317654 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:50.323393 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:50.666914 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:50.850439 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:20:51.875112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found WWN 330000000df5dddca for multipath device dm-0 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:20:51.875112 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:20:51.875530 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== connect_volume: return (2040ms) {'type': 'block', 'scsi_wwn': '330000000df5dddca', 'path': '/dev/dm-0', 'multipath_id': '330000000df5dddca'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:20:51.875530 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000df5dddca', 'path': '/dev/dm-0', 'multipath_id': '330000000df5dddca'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:20:51.878526 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'flavor' on Instance uuid 337a804b-18df-468c-ae55-d67ca3d7dbd5 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:51.898071 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:51.898350 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:52.383017 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Attempting to attach volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] attach device xml: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: Jul 03 04:20:52.387054 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:20:52.402407 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:52.609007 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:52.913592 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.731s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:52.913592 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:20:52.915042 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.248s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:53.039855 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:53.420675 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:20:53.422051 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:20:53.422397 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:53.424703 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:53.548764 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af92ec9d358c4fcd997ca5ca9acfe7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82604b4949eb47659d954def4e326795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:20:53.609749 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:53.609961 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:53.924457 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:20:54.082672 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:54.082867 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:54.083035 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:54.083216 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:85:7f:41, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:54.116355 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:54.268177 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Successfully created port: cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:20:54.429186 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:20:54.623983 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.709s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:54.685122 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Deleted allocations for instance b5ee81e7-eef9-4b72-a375-30801621eafc Jul 03 04:20:54.876976 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Successfully updated port: cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:20:54.940919 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received event network-changed-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:54.941278 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Refreshing instance network info cache due to event network-changed-cdcdf52e-2bea-41a7-992f-6141d9e7c229. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:20:54.941278 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] Acquiring lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:54.941356 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] Acquired lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:54.941459 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Refreshing network info cache for port cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:20:55.335685 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:55.379063 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:20:55.440157 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:20:55.441098 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:20:55.441377 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Creating image(s) Jul 03 04:20:55.441836 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "/opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:55.441993 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:55.442548 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "/opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:55.443776 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:55.451093 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:55.454410 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:55.457940 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:55.547848 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:55.548390 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:55.548913 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:55.549528 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:55.552525 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:20:55.552916 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:55.572900 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:55.637702 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.084s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:55.638148 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:55.682613 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2238c5f0-c06f-4478-9761-f8704643790a tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.606s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:55.697131 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-00bf2686-acad-4256-afd0-69cae57b07d0 tempest-ServerBootFromVolumeStableRescueTest-1451627323 tempest-ServerBootFromVolumeStableRescueTest-1451627323-project-member] Lock "b5ee81e7-eef9-4b72-a375-30801621eafc" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.058s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:55.716349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk 1073741824" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:55.716731 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.168s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:55.717100 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:55.798870 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:55.807665 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:55.808254 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:20:55.808555 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:20:55.894501 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:20:55.894880 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Cannot resize image /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:20:55.895282 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:20:55.895512 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Ensure instance console log exists: /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:20:55.896675 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:55.896675 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:55.896675 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:56.267175 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:56.267594 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:56.304746 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c9adaf6c-d5ff-4c39-b2d2-47e3d6087c97 req-956829fb-bc3d-4233-a27a-7452a0372087 service nova] Releasing lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:56.305281 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquired lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:20:56.305542 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:20:56.315495 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:56.315935 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:56.770592 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Detaching volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:56.817804 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:20:56.836194 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b38f9111-bf01-40bd-ae5e-873de4cb90f3] Attempting to driver detach volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 from mountpoint /dev/vdb Jul 03 04:20:56.848727 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found disk vdb by alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:20:56.851115 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found disk vdb by alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:20:56.851474 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Attempting to detach device vdb from instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] detach device xml: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]:
Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: Jul 03 04:20:56.851657 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:20:56.863069 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully detached device vdb from instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 from the persistent domain config. Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] (1/8): Attempting to detach device vdb with device alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 from instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] detach device xml: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]:
Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: Jul 03 04:20:56.865103 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:20:56.882303 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:20:57.049129 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:57.180041 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Updating instance_info_cache with network_info: [{"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:20:57.187041 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:57.187228 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:57.187361 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:57.187500 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:57.187593 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:57.192874 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Terminating instance Jul 03 04:20:57.367632 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:57.368057 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:57.371676 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:20:57.371832 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Claim successful on node np0000004364 Jul 03 04:20:57.407811 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:20:57.409294 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 for instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:20:57.414989 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully detached device vdb from instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 from the live domain config. Jul 03 04:20:57.608874 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004796480000095471 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] VM Stopped (Lifecycle Event) Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.0302851399999327 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=2.030179526999973 future=) was cancelled while queued, skipping {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.053809663000038 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.611487 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.053719599000033 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:57.687225 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Releasing lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:20:57.687225 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Instance network_info: |[{"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:20:57.687225 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Start _get_guest_xml network_info=[{"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:20:57.695267 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:20:57.695267 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-26253629', uuid='047087f9-9dc6-43a6-a27b-027548780341'), owner=OwnerMeta(userid='af92ec9d358c4fcd997ca5ca9acfe7c3', username='tempest-ServerRescueNegativeTestJSON-764277257-project-member', projectid='82604b4949eb47659d954def4e326795', projectname='tempest-ServerRescueNegativeTestJSON-764277257'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052457.6941733) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:20:57.700598 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:20:57.701908 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:20:57.702925 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:20:57.704870 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:20:57.705383 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:20:57.706384 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:20:57.708279 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:20:57.709299 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:20:57.709299 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:20:57.709299 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:20:57.709299 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:20:57.709299 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:20:57.709299 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:20:57.710216 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:20:57.710216 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:20:57.710216 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:20:57.710852 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:20:57.726953 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.731694 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-26253629',display_name='tempest-ServerRescueNegativeTestJSON-server-26253629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-26253629',id=24,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE1A5Bn0X+4k8n1x8CZAZpWwCf9tKUlzNehnvCVCja2YJXb4Ki3W/BApuz5+1yFYLcZJXdm2ikUDm//SskR94OMw5zXe6KDzgCvxiLQUR4KE/RRAIKFeNcnxozFvqsmdw==',key_name='tempest-keypair-1146398999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-hzd95w56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=047087f9-9dc6-43a6-a27b-027548780341,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:20:57.731694 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:57.732303 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=cdcdf52e-2bea-41a7-992f-6141d9e7c229,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcdf52e-2b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:57.732940 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'pci_devices' on Instance uuid 047087f9-9dc6-43a6-a27b-027548780341 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:57.738318 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.763399 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.830739 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.843693 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.867976 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.889087 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:57.989409 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Detected multiple connections on this host for volume: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641, skipping target disconnect. Jul 03 04:20:58.044799 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.061214 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99964606200001 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:20:58.063754 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Instance destroyed successfully. Jul 03 04:20:58.064116 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lazy-loading 'resources' on Instance uuid 763d288c-14bd-4ae1-b6bb-adf487165e5c {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:58.113340 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: fab3fe2f-7444-4177-a9ff-0e9b068efe7c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] End _get_guest_xml xml= Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 047087f9-9dc6-43a6-a27b-027548780341 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: instance-00000018 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 196608 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-server-26253629 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 2026-07-03 04:20:57 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 192 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: True Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: bare Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 0 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: virtio Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257-project-member Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: tempest-ServerRescueNegativeTestJSON-764277257 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 047087f9-9dc6-43a6-a27b-027548780341 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 047087f9-9dc6-43a6-a27b-027548780341 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: hvm Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 128 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: 1 Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: Jul 03 04:20:58.236860 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:20:58.238927 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Preparing to wait for external event network-vif-plugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:20:58.238927 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "047087f9-9dc6-43a6-a27b-027548780341-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:58.238927 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:58.238927 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:58.238927 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-26253629',display_name='tempest-ServerRescueNegativeTestJSON-server-26253629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverrescuenegativetestjson-server-26253629',id=24,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE1A5Bn0X+4k8n1x8CZAZpWwCf9tKUlzNehnvCVCja2YJXb4Ki3W/BApuz5+1yFYLcZJXdm2ikUDm//SskR94OMw5zXe6KDzgCvxiLQUR4KE/RRAIKFeNcnxozFvqsmdw==',key_name='tempest-keypair-1146398999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82604b4949eb47659d954def4e326795',ramdisk_id='',reservation_id='r-hzd95w56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-764277257',owner_user_name='tempest-ServerRescueNegativeTestJSON-764277257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af92ec9d358c4fcd997ca5ca9acfe7c3',uuid=047087f9-9dc6-43a6-a27b-027548780341,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:20:58.238927 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converting VIF {"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:58.239242 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=cdcdf52e-2bea-41a7-992f-6141d9e7c229,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcdf52e-2b') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:58.239473 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=cdcdf52e-2bea-41a7-992f-6141d9e7c229,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcdf52e-2b') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:20:58.239778 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.240069 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.240392 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:20:58.241313 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.241723 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7744ef2d-4256-5c9f-b486-7c7afeb671ba', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.242269 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.243054 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:58.249059 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.252139 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.252381 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdcdf52e-2b, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.252778 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdcdf52e-2b, col_values=(('qos', UUID('3ee9ff66-6024-4d53-84ff-1ef03cfd59e0')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.252980 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdcdf52e-2b, col_values=(('external_ids', {'iface-id': 'cdcdf52e-2bea-41a7-992f-6141d9e7c229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:54:d6', 'vm-uuid': '047087f9-9dc6-43a6-a27b-027548780341'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.254018 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.255480 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:58.266392 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.267772 np0000004364 nova-compute[98951]: INFO os_vif [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=cdcdf52e-2bea-41a7-992f-6141d9e7c229,network=Network(f9ae278d-8a7d-486c-95c6-1ca3bf684665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdcdf52e-2b') Jul 03 04:20:58.463613 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a96b64bb-95a8-44b9-810e-6fb98d66a2ff req-07aac771-293c-42ef-bbdf-e6cab231715d service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received event network-vif-unplugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:58.464014 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a96b64bb-95a8-44b9-810e-6fb98d66a2ff req-07aac771-293c-42ef-bbdf-e6cab231715d service nova] Acquiring lock "047087f9-9dc6-43a6-a27b-027548780341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:58.464052 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a96b64bb-95a8-44b9-810e-6fb98d66a2ff req-07aac771-293c-42ef-bbdf-e6cab231715d service nova] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:58.464198 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a96b64bb-95a8-44b9-810e-6fb98d66a2ff req-07aac771-293c-42ef-bbdf-e6cab231715d service nova] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:58.464370 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a96b64bb-95a8-44b9-810e-6fb98d66a2ff req-07aac771-293c-42ef-bbdf-e6cab231715d service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] No event matching network-vif-unplugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 in dict_keys([('network-vif-plugged', 'cdcdf52e-2bea-41a7-992f-6141d9e7c229')]) {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jul 03 04:20:58.464963 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-a96b64bb-95a8-44b9-810e-6fb98d66a2ff req-07aac771-293c-42ef-bbdf-e6cab231715d service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received unexpected event network-vif-unplugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 for instance with vm_state building and task_state spawning. Jul 03 04:20:58.565450 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'flavor' on Instance uuid b38f9111-bf01-40bd-ae5e-873de4cb90f3 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:20:58.567602 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1804844329',display_name='tempest-ServersNegativeTestJSON-server-1804844329',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serversnegativetestjson-server-1804844329',id=19,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-07-03T04:20:21Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='fc3628de66374638b6a90f8481b23f1a',ramdisk_id='',reservation_id='r-wepo064q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-77201445',owner_user_name='tempest-ServersNegativeTestJSON-77201445-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:22Z,user_data=None,user_id='8291a3e27ced4dae9272827563b8f819',uuid=763d288c-14bd-4ae1-b6bb-adf487165e5c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:20:58.567846 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converting VIF {"id": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "address": "fa:16:3e:dc:1a:7a", "network": {"id": "e1b7489c-e986-4a4c-98b2-394498061235", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-242682300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fc3628de66374638b6a90f8481b23f1a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a1cf1-f7", "ovs_interfaceid": "b98a1cf1-f7f3-4a04-9fe9-1a6541705adf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:20:58.568381 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:20:58.568586 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:20:58.572097 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.572256 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb98a1cf1-f7, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.573648 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.576521 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:58.580539 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.581248 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.581248 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12d0d3cd-6a7b-4ea7-a3c4-a66e3e99e206) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:20:58.581739 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.582358 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:20:58.588674 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:20:58.594242 np0000004364 nova-compute[98951]: INFO os_vif [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1a:7a,bridge_name='br-int',has_traffic_filtering=True,id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf,network=Network(e1b7489c-e986-4a4c-98b2-394498061235),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a1cf1-f7') Jul 03 04:20:58.594493 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Deleting instance files /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c_del Jul 03 04:20:58.597306 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Deletion of /opt/stack/data/nova/instances/763d288c-14bd-4ae1-b6bb-adf487165e5c_del complete Jul 03 04:20:58.957260 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:20:58.957465 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:20:59.107236 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Took 1.41 seconds to destroy the instance on the hypervisor. Jul 03 04:20:59.107826 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:20:59.108029 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:20:59.108137 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:20:59.108381 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:59.239820 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:20:59.460090 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:20:59.576450 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-f8db169f-1e42-44c9-ac9d-39068470473e tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b38f9111-bf01-40bd-ae5e-873de4cb90f3" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.308s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:59.598700 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4a47d912-78ed-46fa-956a-d265d29f6fed req-8a38f359-75ec-4cf6-8f41-53e03dc48390 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-deleted-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:20:59.599225 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-4a47d912-78ed-46fa-956a-d265d29f6fed req-8a38f359-75ec-4cf6-8f41-53e03dc48390 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Neutron deleted interface b98a1cf1-f7f3-4a04-9fe9-1a6541705adf; detaching it from the instance and deleting it from the info cache Jul 03 04:20:59.600383 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4a47d912-78ed-46fa-956a-d265d29f6fed req-8a38f359-75ec-4cf6-8f41-53e03dc48390 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Detach interface failed, port_id=b98a1cf1-f7f3-4a04-9fe9-1a6541705adf, reason: Instance 763d288c-14bd-4ae1-b6bb-adf487165e5c could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:20:59.706934 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:20:59.707073 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:20:59.786793 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:59.786941 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:20:59.787048 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] No VIF found with MAC fa:16:3e:56:54:d6, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:20:59.787475 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Using config drive Jul 03 04:20:59.968188 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.600s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:20:59.968671 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:21:00.053075 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:00.209517 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Detaching volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:21:00.257937 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Attempting to driver detach volume 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 from mountpoint /dev/vdb Jul 03 04:21:00.261208 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found disk vdb by alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:21:00.263115 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Found disk vdb by alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:21:00.263241 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Attempting to detach device vdb from instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] detach device xml: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]:
Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: Jul 03 04:21:00.266361 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:00.271375 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully detached device vdb from instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 from the persistent domain config. Jul 03 04:21:00.271586 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] (1/8): Attempting to detach device vdb with device alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 from instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] detach device xml: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: 70ba1ab5-fd0e-434d-8457-0ebf2f6db641 Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]:
Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: Jul 03 04:21:00.272650 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:00.294669 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:00.348448 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:00.453924 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Creating config drive at /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk.config Jul 03 04:21:00.459281 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo_gol84e {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:00.481796 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:21:00.482243 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:21:00.483052 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:00.484297 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:00.521889 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo_gol84e" returned: 0 in 0.062s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:00.527962 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-unplugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:00.528244 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:00.528474 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:00.528676 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:00.528742 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] No waiting events found dispatching network-vif-unplugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:00.528996 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-unplugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:21:00.530651 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-unplugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:00.530948 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] Acquiring lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:00.531498 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:00.531498 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:00.531684 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] No waiting events found dispatching network-vif-unplugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:00.531844 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-14a62f37-963a-4d39-96e2-9a3b7eff004b req-6b5cd73a-3315-4d14-919f-ded97933a063 service nova] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Received event network-vif-unplugged-b98a1cf1-f7f3-4a04-9fe9-1a6541705adf for instance with task_state deleting. {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11774}} Jul 03 04:21:00.555043 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Took 1.45 seconds to deallocate network for instance. Jul 03 04:21:00.575548 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1712714739264874b1d368fb1ce6cedf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e238c107920c40139ecebfc8bed78991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:21:00.930450 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:00.963142 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:00.966598 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:00.967396 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:00.989079 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:21:01.047452 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Successfully created port: f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:21:01.054299 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:01.062440 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:01.062668 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:01.098361 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:01.098361 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:01.494120 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:21:01.631976 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Successfully updated port: f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:21:01.666584 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004358499998033949 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:01.666584 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:01.666584 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.8481811770000149 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:01.666584 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.8480975840000156 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:01.666834 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:01.666834 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] VM Stopped (Lifecycle Event) Jul 03 04:21:01.685512 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Received event network-changed-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:01.687725 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Refreshing instance network info cache due to event network-changed-f53f2d7e-d7ab-40a3-9258-72fc102ca834. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:01.687725 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] Acquiring lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:01.687725 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] Acquired lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:01.687725 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Refreshing network info cache for port f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:01.714613 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:21:01.714901 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:21:01.776074 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:01.777041 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] VM Started (Lifecycle Event) Jul 03 04:21:02.141360 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:02.169307 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-2122ca4f-faf5-4729-a687-5a192ed5d9db tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: a20214c3-5676-4986-83ae-3bbfb7789732] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:02.189268 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:02.217732 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:21:02.254076 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:02.279343 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:02.282073 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:02.282178 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] VM Paused (Lifecycle Event) Jul 03 04:21:02.411484 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:02.514716 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003357420000611455 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:02.514716 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:02.514879 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.546090982999885 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:02.515908 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.544902367999839 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:02.516177 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:02.516362 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] VM Stopped (Lifecycle Event) Jul 03 04:21:02.517482 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:21:02.518406 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:21:02.523696 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Creating image(s) Jul 03 04:21:02.524447 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:02.524653 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "/opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:02.525172 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "/opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:02.525889 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:02.529167 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:02.530484 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:02.617081 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.086s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:02.617522 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:02.617992 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:02.618484 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:02.621856 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:02.626388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:02.626388 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received event network-vif-plugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:02.626388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] Acquiring lock "047087f9-9dc6-43a6-a27b-027548780341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:02.626388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:02.626388 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:02.627215 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Processing event network-vif-plugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:21:02.627215 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received event network-vif-plugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:02.627215 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] Acquiring lock "047087f9-9dc6-43a6-a27b-027548780341-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:02.627215 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:02.627400 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] Lock "047087f9-9dc6-43a6-a27b-027548780341-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:02.627568 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] No waiting events found dispatching network-vif-plugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:02.627703 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8d285197-a786-4178-8028-514b68eb2dd8 req-954d325c-5c89-456d-8e06-13f3cb6b3032 service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received unexpected event network-vif-plugged-cdcdf52e-2bea-41a7-992f-6141d9e7c229 for instance with vm_state building and task_state spawning. Jul 03 04:21:02.628907 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:21:02.649303 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:21:02.660431 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Instance spawned successfully. Jul 03 04:21:02.663166 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:21:02.714560 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:02.715153 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:02.735676 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.672s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:02.780302 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk 1073741824" returned: 0 in 0.065s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:02.780765 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.163s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:02.781179 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:02.804486 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:02.818147 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:02.818393 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] VM Resumed (Lifecycle Event) Jul 03 04:21:02.841608 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Deleted allocations for instance 763d288c-14bd-4ae1-b6bb-adf487165e5c Jul 03 04:21:02.866374 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.085s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:02.866897 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:21:02.867163 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:02.914176 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-82a6bacc-8cba-4e73-85a2-e7393f252a42 req-adcf9025-2cb7-4125-8ca4-40d032375c7e service nova] Releasing lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:02.916578 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquired lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:02.916578 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:21:02.946469 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:02.946866 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Cannot resize image /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:21:02.947243 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:21:02.947432 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Ensure instance console log exists: /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:21:02.947700 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:02.947911 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:02.948034 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:03.019601 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-70b7f6f9-bb85-4570-83cc-f75d46c199e8 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] [instance: b5ee81e7-eef9-4b72-a375-30801621eafc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:03.171431 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:03.171431 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:03.171431 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:03.171431 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:03.171431 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:03.171431 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:03.321987 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:03.323563 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:03.484358 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:03.546420 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 for instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:21:03.586422 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:03.630354 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:03.677649 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Took 8.24 seconds to spawn the instance on the hypervisor. Jul 03 04:21:03.678055 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:03.786000 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Updating instance_info_cache with network_info: [{"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:03.825888 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 047087f9-9dc6-43a6-a27b-027548780341] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:21:03.826382 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-70ba1ab5-fd0e-434d-8457-0ebf2f6db641> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:21:03.830508 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully detached device vdb from instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 from the live domain config. Jul 03 04:21:03.850623 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-5dc989ef-3121-4992-919d-2051b18dab57 tempest-ServersNegativeTestJSON-77201445 tempest-ServersNegativeTestJSON-77201445-project-member] Lock "763d288c-14bd-4ae1-b6bb-adf487165e5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.663s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:03.874672 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:21:03.875193 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:03.875685 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:03.876102 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:03.876990 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:21:03.876990 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:21:03.910026 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641 (non-flash) Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:03.910517 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', '40')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:21:03.910992 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', '39')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:03.911808 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641', '40')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:03.912680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Resulting device map defaultdict(. at 0x76c458229f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'): ({'sdb'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:21:03.912936 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Removing multipathed devices sdc, sdb {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:21:03.913215 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flush multipath device 330000000df5dddca {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:21:03.952039 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:04.007489 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:04.055648 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:21:04.055859 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:21:04.056917 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:21:04.067893 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:21:04.068113 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:21:04.080391 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:04.122727 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.40.100,3260] Jul 03 04:21:04.122727 np0000004364 nova-compute[98951]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.40.100,3260] successful. Jul 03 04:21:04.122727 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:04.140259 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:04.155680 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:04.192401 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Took 14.07 seconds to build instance. Jul 03 04:21:04.193732 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.50.100,3260] Jul 03 04:21:04.193732 np0000004364 nova-compute[98951]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-70ba1ab5-fd0e-434d-8457-0ebf2f6db641, portal: 192.168.50.100,3260] successful. Jul 03 04:21:04.193732 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:04.211003 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:04.211295 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:04.211408 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] <== disconnect_volume: return (335ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:04.211499 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:21:04.292317 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Releasing lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:04.292317 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Instance network_info: |[{"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:21:04.295603 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Start _get_guest_xml network_info=[{"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:21:04.306007 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:21:04.311606 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1043391690', uuid='d7a3727c-3c5e-4296-80c1-8098dd672b3e'), owner=OwnerMeta(userid='1712714739264874b1d368fb1ce6cedf', username='tempest-AttachVolumeNegativeTest-73840185-project-member', projectid='e238c107920c40139ecebfc8bed78991', projectname='tempest-AttachVolumeNegativeTest-73840185'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052464.3108819) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:21:04.315526 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:21:04.315993 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:21:04.317400 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:21:04.317781 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:21:04.318815 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:21:04.319369 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:21:04.319883 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:21:04.320041 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:21:04.320213 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:21:04.320341 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:21:04.320493 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:21:04.321014 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:21:04.321168 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:21:04.321313 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:21:04.321543 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:21:04.321622 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:21:04.335383 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1043391690',display_name='tempest-AttachVolumeNegativeTest-server-1043391690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachvolumenegativetest-server-1043391690',id=25,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQnOYbmQxQXgUDjyNjdkjCB/oX9+lAD7eUsUV5iInu4TsywzulAyWh+A2FnVf1VN01hPibifbihKG5ojp9r1KU/XTbCUYOyKbTP5aZCWWSkspbMef+MYOMMPixvdt6rYA==',key_name='tempest-keypair-130090808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e238c107920c40139ecebfc8bed78991',ramdisk_id='',reservation_id='r-c4hrpbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-73840185',owner_user_name='tempest-AttachVolumeNegativeTest-73840185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1712714739264874b1d368fb1ce6cedf',uuid=d7a3727c-3c5e-4296-80c1-8098dd672b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:04.335606 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Converting VIF {"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:04.336920 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:86:5b,bridge_name='br-int',has_traffic_filtering=True,id=f53f2d7e-d7ab-40a3-9258-72fc102ca834,network=Network(8e4667ff-408c-42e7-ae86-8575b31eaf65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53f2d7e-d7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:04.336920 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lazy-loading 'pci_devices' on Instance uuid d7a3727c-3c5e-4296-80c1-8098dd672b3e {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:04.695250 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-35609a7c-9c59-4cf2-9140-526641904ca9 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "047087f9-9dc6-43a6-a27b-027548780341" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.580s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:04.767168 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'flavor' on Instance uuid 337a804b-18df-468c-ae55-d67ca3d7dbd5 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] End _get_guest_xml xml= Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: d7a3727c-3c5e-4296-80c1-8098dd672b3e Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: instance-00000019 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: tempest-AttachVolumeNegativeTest-server-1043391690 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 2026-07-03 04:21:04 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: True Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: bare Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: tempest-AttachVolumeNegativeTest-73840185-project-member Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: tempest-AttachVolumeNegativeTest-73840185 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: d7a3727c-3c5e-4296-80c1-8098dd672b3e Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: d7a3727c-3c5e-4296-80c1-8098dd672b3e Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: hvm Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 128 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: Jul 03 04:21:04.839244 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Preparing to wait for external event network-vif-plugged-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Acquiring lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1043391690',display_name='tempest-AttachVolumeNegativeTest-server-1043391690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachvolumenegativetest-server-1043391690',id=25,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQnOYbmQxQXgUDjyNjdkjCB/oX9+lAD7eUsUV5iInu4TsywzulAyWh+A2FnVf1VN01hPibifbihKG5ojp9r1KU/XTbCUYOyKbTP5aZCWWSkspbMef+MYOMMPixvdt6rYA==',key_name='tempest-keypair-130090808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e238c107920c40139ecebfc8bed78991',ramdisk_id='',reservation_id='r-c4hrpbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-73840185',owner_user_name='tempest-AttachVolumeNegativeTest-73840185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1712714739264874b1d368fb1ce6cedf',uuid=d7a3727c-3c5e-4296-80c1-8098dd672b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Converting VIF {"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:86:5b,bridge_name='br-int',has_traffic_filtering=True,id=f53f2d7e-d7ab-40a3-9258-72fc102ca834,network=Network(8e4667ff-408c-42e7-ae86-8575b31eaf65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53f2d7e-d7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:04.842871 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:86:5b,bridge_name='br-int',has_traffic_filtering=True,id=f53f2d7e-d7ab-40a3-9258-72fc102ca834,network=Network(8e4667ff-408c-42e7-ae86-8575b31eaf65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53f2d7e-d7') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:21:04.843928 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:04.844088 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:04.844580 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:21:04.848147 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:04.848147 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ddc84cc-bacc-5ed2-a4ee-fa4c1b49ad78', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:04.851722 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:04.853059 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:04.855588 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:04.855588 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf53f2d7e-d7, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:04.855801 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf53f2d7e-d7, col_values=(('qos', UUID('1e3aa9df-e268-45f8-9c60-e3f7b74818c5')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:04.856404 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf53f2d7e-d7, col_values=(('external_ids', {'iface-id': 'f53f2d7e-d7ab-40a3-9258-72fc102ca834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:86:5b', 'vm-uuid': 'd7a3727c-3c5e-4296-80c1-8098dd672b3e'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:04.857662 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:04.859441 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:04.864398 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:04.865862 np0000004364 nova-compute[98951]: INFO os_vif [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:86:5b,bridge_name='br-int',has_traffic_filtering=True,id=f53f2d7e-d7ab-40a3-9258-72fc102ca834,network=Network(8e4667ff-408c-42e7-ae86-8575b31eaf65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf53f2d7e-d7') Jul 03 04:21:05.096753 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Received event network-changed-cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:05.098354 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Refreshing instance network info cache due to event network-changed-cdcdf52e-2bea-41a7-992f-6141d9e7c229. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:05.098354 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] Acquiring lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:05.098354 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] Acquired lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:05.098354 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Refreshing network info cache for port cdcdf52e-2bea-41a7-992f-6141d9e7c229 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:05.350040 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:05.600980 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:05.673372 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:05.773971 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-b673b007-bee2-4069-8155-f4dccf6a00c7 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "337a804b-18df-468c-ae55-d67ca3d7dbd5" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.066s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:06.017094 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:06.174241 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Updated VIF entry in instance network info cache for port cdcdf52e-2bea-41a7-992f-6141d9e7c229. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:21:06.174525 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] [instance: 047087f9-9dc6-43a6-a27b-027548780341] Updating instance_info_cache with network_info: [{"id": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "address": "fa:16:3e:56:54:d6", "network": {"id": "f9ae278d-8a7d-486c-95c6-1ca3bf684665", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2144832410-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82604b4949eb47659d954def4e326795", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdcdf52e-2b", "ovs_interfaceid": "cdcdf52e-2bea-41a7-992f-6141d9e7c229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:06.389681 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:06.390179 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:06.390179 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] No VIF found with MAC fa:16:3e:a5:86:5b, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:06.390810 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Using config drive Jul 03 04:21:06.676527 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-3aa89629-9148-48b9-90d3-7d989762abd4 req-e6945d02-f799-4238-bf34-37fcbbd0a40f service nova] Releasing lock "refresh_cache-047087f9-9dc6-43a6-a27b-027548780341" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:06.897051 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:07.061556 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Creating config drive at /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk.config Jul 03 04:21:07.068142 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3d5tylf6 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:07.132063 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3d5tylf6" returned: 0 in 0.064s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:07.203746 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:07.203746 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:07.647782 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:07.672846 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:07.675945 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:07.706366 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:21:07.766758 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:07.884056 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-42e740b7-15ce-483a-9480-cbbc7694373a req-4f90cbdf-f9a2-4635-b554-4e9c77e6bef6 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Received event network-vif-plugged-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:07.884518 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-42e740b7-15ce-483a-9480-cbbc7694373a req-4f90cbdf-f9a2-4635-b554-4e9c77e6bef6 service nova] Acquiring lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:07.887593 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-42e740b7-15ce-483a-9480-cbbc7694373a req-4f90cbdf-f9a2-4635-b554-4e9c77e6bef6 service nova] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:07.887846 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-42e740b7-15ce-483a-9480-cbbc7694373a req-4f90cbdf-f9a2-4635-b554-4e9c77e6bef6 service nova] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:07.887996 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-42e740b7-15ce-483a-9480-cbbc7694373a req-4f90cbdf-f9a2-4635-b554-4e9c77e6bef6 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Processing event network-vif-plugged-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:21:08.031948 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:08.035710 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:08.040132 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:08.066901 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:08.269310 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:08.269566 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:08.274840 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:21:08.274985 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Claim successful on node np0000004364 Jul 03 04:21:08.561703 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:08.561703 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] VM Started (Lifecycle Event) Jul 03 04:21:08.562224 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:21:08.564688 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:21:08.567088 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Instance spawned successfully. Jul 03 04:21:08.568421 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:21:08.990910 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:08.990910 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:09.064081 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:09.067389 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:09.075413 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:09.075629 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:09.075998 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:09.076291 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:09.076650 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:09.076912 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:09.493522 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Detaching volume 3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:21:09.559997 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Attempting to driver detach volume 3bb72e81-8887-4c25-9d18-198b92bb2860 from mountpoint /dev/vdb Jul 03 04:21:09.568756 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:21:09.569146 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:09.569417 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] VM Paused (Lifecycle Event) Jul 03 04:21:09.571289 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Found disk vdb by alias ua-3bb72e81-8887-4c25-9d18-198b92bb2860 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:21:09.573423 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Found disk vdb by alias ua-3bb72e81-8887-4c25-9d18-198b92bb2860 {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:21:09.573589 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Attempting to detach device vdb from instance 8797c544-317e-4ae4-9a84-512976e3225f from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] detach device xml: Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: 3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]:
Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: Jul 03 04:21:09.573889 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:09.581290 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Took 7.06 seconds to spawn the instance on the hypervisor. Jul 03 04:21:09.581458 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:09.593219 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Successfully detached device vdb from instance 8797c544-317e-4ae4-9a84-512976e3225f from the persistent domain config. Jul 03 04:21:09.597035 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] (1/8): Attempting to detach device vdb with device alias ua-3bb72e81-8887-4c25-9d18-198b92bb2860 from instance 8797c544-317e-4ae4-9a84-512976e3225f from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] detach device xml: Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: 3bb72e81-8887-4c25-9d18-198b92bb2860 Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]:
Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: Jul 03 04:21:09.601284 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:09.870347 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:09.901743 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:21:09.902764 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:21:09.996260 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-59871d6c-371e-43a9-bd0e-99f3a5a1090c req-f818d149-2c06-47e9-b4aa-1ffb9e001356 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Received event network-vif-plugged-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:10.001113 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-59871d6c-371e-43a9-bd0e-99f3a5a1090c req-f818d149-2c06-47e9-b4aa-1ffb9e001356 service nova] Acquiring lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:10.001113 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-59871d6c-371e-43a9-bd0e-99f3a5a1090c req-f818d149-2c06-47e9-b4aa-1ffb9e001356 service nova] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:10.001113 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-59871d6c-371e-43a9-bd0e-99f3a5a1090c req-f818d149-2c06-47e9-b4aa-1ffb9e001356 service nova] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:10.001113 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-59871d6c-371e-43a9-bd0e-99f3a5a1090c req-f818d149-2c06-47e9-b4aa-1ffb9e001356 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] No waiting events found dispatching network-vif-plugged-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:10.001113 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-59871d6c-371e-43a9-bd0e-99f3a5a1090c req-f818d149-2c06-47e9-b4aa-1ffb9e001356 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Received unexpected event network-vif-plugged-f53f2d7e-d7ab-40a3-9258-72fc102ca834 for instance with vm_state active and task_state None. Jul 03 04:21:10.074282 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:10.076223 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:10.076223 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] VM Resumed (Lifecycle Event) Jul 03 04:21:10.099599 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Took 12.78 seconds to build instance. Jul 03 04:21:10.105083 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:10.267139 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3bb72e81-8887-4c25-9d18-198b92bb2860 for instance 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:21:10.353885 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:10.406390 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:21:10.578936 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:10.582741 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:10.602583 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-843c5fae-a2fa-4caf-933b-dc0874effa86 tempest-AttachVolumeNegativeTest-73840185 tempest-AttachVolumeNegativeTest-73840185-project-member] Lock "d7a3727c-3c5e-4296-80c1-8098dd672b3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.286s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:10.912056 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.642s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:10.912420 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:21:11.040106 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Received event network-changed-f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:11.040106 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Refreshing instance network info cache due to event network-changed-f53f2d7e-d7ab-40a3-9258-72fc102ca834. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:11.040550 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] Acquiring lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:11.040550 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] Acquired lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:11.040676 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Refreshing network info cache for port f53f2d7e-d7ab-40a3-9258-72fc102ca834 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:11.086804 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-3bb72e81-8887-4c25-9d18-198b92bb2860> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:21:11.092321 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Successfully detached device vdb from instance 8797c544-317e-4ae4-9a84-512976e3225f from the live domain config. Jul 03 04:21:11.094341 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:21:11.094861 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:11.095173 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:11.095741 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:11.096140 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bb72e81-8887-4c25-9d18-198b92bb2860', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:21:11.096551 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '38')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:21:11.123863 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '35')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:11.125214 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860', '36')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:11.126178 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Resulting device map defaultdict(. at 0x76c45046e2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'): ({'sdf'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:21:11.126519 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Removing multipathed devices sdf, sdg {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:21:11.126836 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Flush multipath device 3300000006e44275e {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:21:11.166404 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:11.212655 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:11.261184 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:21:11.261184 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:21:11.261184 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:21:11.273985 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:21:11.273985 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:21:11.283625 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:11.317648 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.40.100,3260] Jul 03 04:21:11.317648 np0000004364 nova-compute[98951]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.40.100,3260] successful. Jul 03 04:21:11.317648 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:11.334651 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:11.350977 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:11.379131 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.50.100,3260] Jul 03 04:21:11.379131 np0000004364 nova-compute[98951]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-3bb72e81-8887-4c25-9d18-198b92bb2860, portal: 192.168.50.100,3260] successful. Jul 03 04:21:11.379131 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:11.394143 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:11.399894 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:11.403578 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:11.403578 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] <== disconnect_volume: return (306ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:11.403578 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:21:11.423454 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:21:11.423454 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:21:11.424177 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:11.424177 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:11.518257 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18cf98c1da954ad0bdb32a5854b3ba36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9de1e5af73b486dbece4a569eeaaa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:21:11.545012 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:11.930839 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:21:11.967297 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'flavor' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:11.976410 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:11.995079 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:12.061259 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Successfully created port: 73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:21:12.125771 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "interface-c7760c72-db16-418b-b3b8-84fab8054f20-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:12.125943 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "interface-c7760c72-db16-418b-b3b8-84fab8054f20-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:12.126202 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'flavor' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:12.151813 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Updated VIF entry in instance network info cache for port f53f2d7e-d7ab-40a3-9258-72fc102ca834. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:21:12.151997 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] [instance: d7a3727c-3c5e-4296-80c1-8098dd672b3e] Updating instance_info_cache with network_info: [{"id": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "address": "fa:16:3e:a5:86:5b", "network": {"id": "8e4667ff-408c-42e7-ae86-8575b31eaf65", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1772578244-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e238c107920c40139ecebfc8bed78991", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf53f2d7e-d7", "ovs_interfaceid": "f53f2d7e-d7ab-40a3-9258-72fc102ca834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:12.435458 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:21:12.629233 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:12.653834 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-470f0ee3-8ef9-4b04-9a80-f9533790dbde req-03010e48-53e8-4000-aee9-40922d2c5626 service nova] Releasing lock "refresh_cache-d7a3727c-3c5e-4296-80c1-8098dd672b3e" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:12.755046 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Successfully updated port: 73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:21:12.810179 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Received event network-changed-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:12.810947 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Refreshing instance network info cache due to event network-changed-73eca3e4-62a9-4cc6-89fb-3e41299e197f. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:12.810947 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] Acquiring lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:12.810947 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] Acquired lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:12.810947 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Refreshing network info cache for port 73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:12.817905 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'pci_requests' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:12.977949 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-2cb2cbba-b979-4054-a29c-35b904a98a93 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.986s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:13.063621 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0024532900001759117 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:13.063621 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:13.064282 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:13.064282 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] VM Stopped (Lifecycle Event) Jul 03 04:21:13.257143 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:13.316207 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:13.323947 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Object Instance lazy-loaded attributes: flavor,pci_requests {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:21:13.325089 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:21:13.325089 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:13.325089 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:13.433896 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:13.441132 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de4ae2700e8a4e6180b4f7f872b48aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470ce7b097604ff79ffa0835affde06b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:21:13.447625 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:21:13.449923 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:21:13.450540 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Creating image(s) Jul 03 04:21:13.451268 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "/opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:13.451594 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:13.455062 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:13.456258 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:13.464904 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:13.467748 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:13.567431 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-319b1b61-e595-4242-9872-557a37f35a42 tempest-DeleteServersTestJSON-1622911531 tempest-DeleteServersTestJSON-1622911531-project-member] [instance: 763d288c-14bd-4ae1-b6bb-adf487165e5c] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:13.571122 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.103s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:13.577401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:13.578386 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:13.579255 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:13.585171 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:13.586765 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:13.709585 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.121s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:13.713773 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:13.781695 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:13.785061 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk 1073741824" returned: 0 in 0.074s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:13.786148 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.208s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:13.786590 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:13.879102 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.092s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:13.880677 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:21:13.880928 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:13.940392 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:13.940607 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:13.941194 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "8797c544-317e-4ae4-9a84-512976e3225f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:13.941194 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:13.941194 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:13.947124 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Terminating instance Jul 03 04:21:13.975932 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Successfully created port: 852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:21:13.985419 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:13.985754 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Cannot resize image /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:21:13.986043 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:21:13.986819 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Ensure instance console log exists: /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:21:13.986819 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:13.986819 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:13.986819 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:14.311132 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-944c57c2-7613-40d5-89f0-bf7f5e14b299 req-b5a7292f-b802-461f-ba7a-0e71769a29e6 service nova] Releasing lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:14.313087 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquired lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:14.313087 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:21:14.451385 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Start destroying the instance on the hypervisor. {{(pid=98951) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3339}} Jul 03 04:21:14.479678 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.483081 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.504153 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.507405 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.527743 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.535939 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.573590 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Successfully updated port: 852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:21:14.641874 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-changed-852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:14.642458 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Refreshing instance network info cache due to event network-changed-852a8c97-f327-4ce6-b02b-74a1bd46c367. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:14.642675 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] Acquiring lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:14.642807 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] Acquired lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:14.642964 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Refreshing network info cache for port 852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:14.781252 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.99967037700003 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:14.781739 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99908341399987 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:14.781886 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998920945999998 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:14.787377 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Instance destroyed successfully. Jul 03 04:21:14.788796 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lazy-loading 'resources' on Instance uuid 8797c544-317e-4ae4-9a84-512976e3225f {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:14.872991 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:14.909784 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:15.076473 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:15.091470 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:15.148734 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:15.245811 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Updating instance_info_cache with network_info: [{"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:15.291288 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-589779902',display_name='tempest-ServerStableDeviceRescueTest-server-589779902',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serverstabledevicerescuetest-server-589779902',id=13,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/0M+SZsgUuhYAO8ZEsx9JJuvYP56lAldRqOM6z3mK1R0DTeikdK/ZpA8jv5jBrPjRCnsHJSpGqsSAmJXXGhuJHViZ1dOlN5jrnRcYNIqBz+90MB+7YvXEbLbXllV1M+A==',key_name='tempest-keypair-1663150320',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:29Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='662ad5b7bca441b387156b61f2272bff',ramdisk_id='',reservation_id='r-srwxoga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-645362785',owner_user_name='tempest-ServerStableDeviceRescueTest-645362785-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f382e83c876463dac1650a3f0272ec5',uuid=8797c544-317e-4ae4-9a84-512976e3225f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:21:15.291623 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converting VIF {"id": "37f407be-ae70-442c-8286-abbac76c494d", "address": "fa:16:3e:ee:b5:97", "network": {"id": "78d4e98f-f168-4bdb-96ca-4256ef410577", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1578182383-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "662ad5b7bca441b387156b61f2272bff", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f407be-ae", "ovs_interfaceid": "37f407be-ae70-442c-8286-abbac76c494d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:15.292240 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:15.292901 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:21:15.294610 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.294925 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37f407be-ae, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:15.297393 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.297393 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:15.301566 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.303016 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.304011 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10592403-6d10-4814-a6aa-1d7e593a4f31) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:15.304011 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.304287 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:15.305664 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.310813 np0000004364 nova-compute[98951]: INFO os_vif [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:97,bridge_name='br-int',has_traffic_filtering=True,id=37f407be-ae70-442c-8286-abbac76c494d,network=Network(78d4e98f-f168-4bdb-96ca-4256ef410577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f407be-ae') Jul 03 04:21:15.310813 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Deleting instance files /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f_del Jul 03 04:21:15.311218 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Deletion of /opt/stack/data/nova/instances/8797c544-317e-4ae4-9a84-512976e3225f_del complete Jul 03 04:21:15.355581 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:15.357717 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "66d28982-e508-4685-82bb-398e93fb4528" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:15.357904 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "66d28982-e508-4685-82bb-398e93fb4528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:15.480434 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:15.624067 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Added VIF to instance network info cache for port 852a8c97-f327-4ce6-b02b-74a1bd46c367. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3531}} Jul 03 04:21:15.624383 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updating instance_info_cache with network_info: [{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:15.747886 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Releasing lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:15.748177 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Instance network_info: |[{"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:21:15.749722 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Start _get_guest_xml network_info=[{"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:21:15.752749 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:21:15.753898 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='406bb9c3-ccdd-460d-9219-c6981c4a6f82'), owner=OwnerMeta(userid='18cf98c1da954ad0bdb32a5854b3ba36', username='tempest-AttachVolumeMultiAttachTest-1445524669-project-member', projectid='f9de1e5af73b486dbece4a569eeaaa68', projectname='tempest-AttachVolumeMultiAttachTest-1445524669'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052475.7535641) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:21:15.758250 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:21:15.758642 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:21:15.759494 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:21:15.759708 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:21:15.760625 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:21:15.760917 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:21:15.761060 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:21:15.761162 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:21:15.761302 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:21:15.761407 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:21:15.761520 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:21:15.761665 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:21:15.761759 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:21:15.761860 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:21:15.761951 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:21:15.762086 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:21:15.780235 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-0',id=26,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-7vs0wyc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=406bb9c3-ccdd-460d-9219-c6981c4a6f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:15.780471 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:15.781017 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c5:22,bridge_name='br-int',has_traffic_filtering=True,id=73eca3e4-62a9-4cc6-89fb-3e41299e197f,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73eca3e4-62') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:15.781599 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'pci_devices' on Instance uuid 406bb9c3-ccdd-460d-9219-c6981c4a6f82 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:15.817475 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Took 1.37 seconds to destroy the instance on the hypervisor. Jul 03 04:21:15.818299 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._common.loopingcall [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98951) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jul 03 04:21:15.818709 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Deallocating network for instance {{(pid=98951) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2463}} Jul 03 04:21:15.818878 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] deallocate_for_instance() {{(pid=98951) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jul 03 04:21:15.819159 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:15.861333 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:21:15.891406 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:16.126714 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-b1d0aead-b8fb-414a-9d0e-7be2ab370396 req-d8737072-ea6e-4f3d-bcb4-2d4b0f999042 service nova] Releasing lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:16.127129 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquired lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:16.127336 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] End _get_guest_xml xml= Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 406bb9c3-ccdd-460d-9219-c6981c4a6f82 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: instance-0000001a Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: multiattach-server-0 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 2026-07-03 04:21:15 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: True Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: bare Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669-project-member Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 406bb9c3-ccdd-460d-9219-c6981c4a6f82 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 406bb9c3-ccdd-460d-9219-c6981c4a6f82 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: hvm Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 128 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: Jul 03 04:21:16.285723 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Preparing to wait for external event network-vif-plugged-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-0',id=26,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-7vs0wyc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=406bb9c3-ccdd-460d-9219-c6981c4a6f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c5:22,bridge_name='br-int',has_traffic_filtering=True,id=73eca3e4-62a9-4cc6-89fb-3e41299e197f,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73eca3e4-62') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c5:22,bridge_name='br-int',has_traffic_filtering=True,id=73eca3e4-62a9-4cc6-89fb-3e41299e197f,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73eca3e4-62') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:16.289265 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:21:16.289960 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.290103 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e4104a2-83c1-546b-af8b-252c36b6493d', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:16.290978 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.293067 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:16.293067 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.294651 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.294816 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73eca3e4-62, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:16.295120 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73eca3e4-62, col_values=(('qos', UUID('e5bf171b-c0f5-4d01-a7a1-e43ba620806c')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:16.295433 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73eca3e4-62, col_values=(('external_ids', {'iface-id': '73eca3e4-62a9-4cc6-89fb-3e41299e197f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:c5:22', 'vm-uuid': '406bb9c3-ccdd-460d-9219-c6981c4a6f82'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:16.296360 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.301889 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:16.309342 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:16.309997 np0000004364 nova-compute[98951]: INFO os_vif [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c5:22,bridge_name='br-int',has_traffic_filtering=True,id=73eca3e4-62a9-4cc6-89fb-3e41299e197f,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73eca3e4-62') Jul 03 04:21:16.372076 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20ce79b8-7e2a-4a6f-b5e8-76710c1dbcb7 req-202fac1c-8651-4b59-927b-85649e66e760 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Received event network-vif-deleted-37f407be-ae70-442c-8286-abbac76c494d {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:16.372514 np0000004364 nova-compute[98951]: INFO nova.compute.manager [req-20ce79b8-7e2a-4a6f-b5e8-76710c1dbcb7 req-202fac1c-8651-4b59-927b-85649e66e760 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Neutron deleted interface 37f407be-ae70-442c-8286-abbac76c494d; detaching it from the instance and deleting it from the info cache Jul 03 04:21:16.377334 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-20ce79b8-7e2a-4a6f-b5e8-76710c1dbcb7 req-202fac1c-8651-4b59-927b-85649e66e760 service nova] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Detach interface failed, port_id=37f407be-ae70-442c-8286-abbac76c494d, reason: Instance 8797c544-317e-4ae4-9a84-512976e3225f could not be found. {{(pid=98951) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11827}} Jul 03 04:21:16.415924 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:16.416094 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:16.418697 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:21:16.418824 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Claim successful on node np0000004364 Jul 03 04:21:16.694995 np0000004364 nova-compute[98951]: WARNING nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] 8f29548d-b3e4-43bf-8861-146eaf54dd6a already exists in list: networks containing: ['8f29548d-b3e4-43bf-8861-146eaf54dd6a']. ignoring it Jul 03 04:21:16.695133 np0000004364 nova-compute[98951]: WARNING nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] 852a8c97-f327-4ce6-b02b-74a1bd46c367 already exists in list: port_ids containing: ['852a8c97-f327-4ce6-b02b-74a1bd46c367']. ignoring it Jul 03 04:21:16.822491 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:16.857785 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:17.191495 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:17.328243 np0000004364 nova-compute[98951]: INFO nova.compute.manager [-] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Took 1.51 seconds to deallocate network for instance. Jul 03 04:21:17.341650 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:17.341650 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:17.341795 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:8e:c5:22, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:17.342240 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Using config drive Jul 03 04:21:17.354890 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updating instance_info_cache with network_info: [{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:17.843458 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:17.852048 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:17.857484 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Releasing lock "refresh_cache-c7760c72-db16-418b-b3b8-84fab8054f20" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:17.859580 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779117799',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-779117799',id=22,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG01GSchcsMSx38ZfTYqg/TH2kuYPxcrMIKUyQQA4dmxeKKXZGEw6So0NOpVy97o7lCf64vPrceOY0K57vXhKJfNsgaQ9RXthAtbaALWl4rLnwB8EHYvJzE9i3Wl/uZwmg==',key_name='tempest-keypair-802072938',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:33Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='470ce7b097604ff79ffa0835affde06b',ramdisk_id='',reservation_id='r-abhge2jh',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428503768',owner_user_name='tempest-TaggedAttachmentsTest-1428503768-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4ae2700e8a4e6180b4f7f872b48aa2',uuid=c7760c72-db16-418b-b3b8-84fab8054f20,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:21:17.859793 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converting VIF {"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:17.860362 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:86:4b,bridge_name='br-int',has_traffic_filtering=True,id=852a8c97-f327-4ce6-b02b-74a1bd46c367,network=Network(8f29548d-b3e4-43bf-8861-146eaf54dd6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852a8c97-f3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:17.860448 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:86:4b,bridge_name='br-int',has_traffic_filtering=True,id=852a8c97-f327-4ce6-b02b-74a1bd46c367,network=Network(8f29548d-b3e4-43bf-8861-146eaf54dd6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852a8c97-f3') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:21:17.861150 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.861522 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:17.861779 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:21:17.863750 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.863978 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e6486bf-c7a3-5cc2-a933-51c68593ae72', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:17.866495 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.867261 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:17.871398 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.874803 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.875026 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap852a8c97-f3, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:17.875455 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap852a8c97-f3, col_values=(('qos', UUID('b9761ddf-91f9-4171-8673-2283252cc397')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:17.875646 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap852a8c97-f3, col_values=(('external_ids', {'iface-id': '852a8c97-f327-4ce6-b02b-74a1bd46c367', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:86:4b', 'vm-uuid': 'c7760c72-db16-418b-b3b8-84fab8054f20'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:17.879924 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.884188 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:17.888578 np0000004364 nova-compute[98951]: INFO os_vif [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:86:4b,bridge_name='br-int',has_traffic_filtering=True,id=852a8c97-f327-4ce6-b02b-74a1bd46c367,network=Network(8f29548d-b3e4-43bf-8861-146eaf54dd6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852a8c97-f3') Jul 03 04:21:17.889164 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779117799',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-779117799',id=22,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG01GSchcsMSx38ZfTYqg/TH2kuYPxcrMIKUyQQA4dmxeKKXZGEw6So0NOpVy97o7lCf64vPrceOY0K57vXhKJfNsgaQ9RXthAtbaALWl4rLnwB8EHYvJzE9i3Wl/uZwmg==',key_name='tempest-keypair-802072938',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:33Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='470ce7b097604ff79ffa0835affde06b',ramdisk_id='',reservation_id='r-abhge2jh',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428503768',owner_user_name='tempest-TaggedAttachmentsTest-1428503768-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4ae2700e8a4e6180b4f7f872b48aa2',uuid=c7760c72-db16-418b-b3b8-84fab8054f20,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:17.889338 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converting VIF {"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:17.889747 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:86:4b,bridge_name='br-int',has_traffic_filtering=True,id=852a8c97-f327-4ce6-b02b-74a1bd46c367,network=Network(8f29548d-b3e4-43bf-8861-146eaf54dd6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852a8c97-f3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] attach device xml: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: Jul 03 04:21:17.890777 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:21:17.912183 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:17.985467 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.043149 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.056653 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Creating config drive at /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk.config Jul 03 04:21:18.064822 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsnzwnnfi {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:18.090270 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:21:18.090987 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:21:18.117345 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsnzwnnfi" returned: 0 in 0.053s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:18.300062 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.305765 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.308275 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.350617 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.440410 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-vif-plugged-852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:18.440744 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:18.446137 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:18.446596 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.005s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:18.446892 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] No waiting events found dispatching network-vif-plugged-852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:18.447253 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received unexpected event network-vif-plugged-852a8c97-f327-4ce6-b02b-74a1bd46c367 for instance with vm_state active and task_state None. Jul 03 04:21:18.447511 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received event network-vif-plugged-852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:18.447773 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:18.448054 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:18.448628 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] Lock "c7760c72-db16-418b-b3b8-84fab8054f20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:18.448792 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] No waiting events found dispatching network-vif-plugged-852a8c97-f327-4ce6-b02b-74a1bd46c367 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:18.448938 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-1a980e05-bd0d-4aed-9c93-749b47276a49 req-99c45d88-f7d0-40b2-8c4e-31284d9d5c86 service nova] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Received unexpected event network-vif-plugged-852a8c97-f327-4ce6-b02b-74a1bd46c367 for instance with vm_state active and task_state None. Jul 03 04:21:18.568467 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.594869 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:21:18.610894 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.709974 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.750556 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:18.751488 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:19.046104 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Rebuilding instance Jul 03 04:21:19.101827 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.686s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:19.102744 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.261s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:19.102955 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:21:19.217261 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:19.369657 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:19.369872 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] VM Started (Lifecycle Event) Jul 03 04:21:19.568196 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:19.569129 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:19.569350 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No VIF found with MAC fa:16:3e:f3:9f:4c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:19.612138 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:21:19.612482 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:21:19.612893 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:19.613285 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:19.732642 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce282df8d387460b9b69b9e7c4898ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2266213579944d8496ab65c02b49e5d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:21:19.750593 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:21:19.750769 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:21:19.872342 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:19.873879 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:19.874012 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] VM Paused (Lifecycle Event) Jul 03 04:21:20.077541 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-779117799', uuid='c7760c72-db16-418b-b3b8-84fab8054f20'), owner=OwnerMeta(userid='de4ae2700e8a4e6180b4f7f872b48aa2', username='tempest-TaggedAttachmentsTest-1428503768-project-member', projectid='470ce7b097604ff79ffa0835affde06b', projectname='tempest-TaggedAttachmentsTest-1428503768'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1799159-0da5-4283-8742-3e8981f646da", "address": "fa:16:3e:f3:9f:4c", "network": {"id": "6e677b2a-7649-448d-8394-d6fbf9829064", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1339294380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1799159-0d", "ovs_interfaceid": "a1799159-0da5-4283-8742-3e8981f646da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052480.0771153) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] set metadata xml: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: tempest-device-tagging-server-779117799 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 2026-07-03 04:21:20 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: True Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: bare Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: ide Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: pc Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: tempest-TaggedAttachmentsTest-1428503768-project-member Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: tempest-TaggedAttachmentsTest-1428503768 Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: Jul 03 04:21:20.078183 np0000004364 nova-compute[98951]: {{(pid=98951) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jul 03 04:21:20.115705 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:21:20.143986 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Successfully created port: 0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:21:20.252427 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.253213 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:21:20.262145 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.274025 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.286642 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.308771 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.314780 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.355985 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.376562 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:20.379104 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Received event network-vif-plugged-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Acquiring lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Processing event network-vif-plugged-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Received event network-vif-plugged-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Acquiring lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] No waiting events found dispatching network-vif-plugged-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Received unexpected event network-vif-plugged-73eca3e4-62a9-4cc6-89fb-3e41299e197f for instance with vm_state building and task_state spawning. Jul 03 04:21:20.550523 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:20.550947 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:20.550947 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:20.550947 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:20.550947 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] No waiting events found dispatching network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:20.551071 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-c8bd94af-ee5d-4c74-adf3-ff414edb2bff req-a4889452-6b0d-46e5-bbe3-1bf3c1b4d178 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received unexpected event network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 for instance with vm_state active and task_state rebuilding. Jul 03 04:21:20.554309 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:21:20.566025 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:21:20.578491 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Instance spawned successfully. Jul 03 04:21:20.579019 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:21:20.580784 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance destroyed successfully. Jul 03 04:21:20.597543 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance destroyed successfully. Jul 03 04:21:20.598619 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1923207365',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionsv293testjson-server-57277548',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Yj2Fyp3SZRpYB2rBZZcPbTWonX/mA+GmC/Vc6BAQrNqVpT6Hc4JpMk5blfi1Ue6dV8mzdRfR7qbmKYTn/T3ZLVG/Cu/bFClo+moYfiL66FdO+6nLEszVXzj7+VwYYeA==',key_name='tempest-keypair-209897224',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:38Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b2f692daeca94508859887b79b6f1ab3',ramdisk_id='',reservation_id='r-wvzshjlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ec5f9610-ac5b-441b-b0d5-db3559298a7e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-223165141',owner_user_name='tempest-ServerActionsV293TestJSON-223165141-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca140c204734e4fbf4eda5377f08fe7',uuid=683d1775-ad4b-4200-9d1d-ef75e6c95064,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jul 03 04:21:20.598870 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converting VIF {"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:20.599446 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:20.599717 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jul 03 04:21:20.601646 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-289a7e22-4094-4886-bf74-8544978c24ed tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "interface-c7760c72-db16-418b-b3b8-84fab8054f20-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 8.475s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:20.606759 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.607307 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccecc6b7-d1, bridge=br-int, if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:20.608319 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.609028 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:20.610785 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.613166 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.613440 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb7021ac-5867-4ca7-94f2-decd296a2ca4) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:20.614490 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.614775 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:20.615476 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:20.619512 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:21:20.622154 np0000004364 nova-compute[98951]: INFO os_vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') Jul 03 04:21:20.624713 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:21:20.625085 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:20.625279 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:20.627873 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:20.628407 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:21:20.628887 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:21:20.661790 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:20.661790 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:20.661790 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:20.661790 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:20.661790 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:20.661999 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:20.661999 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:20.661999 np0000004364 nova-compute[98951]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:20.661999 np0000004364 nova-compute[98951]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:20.661999 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:20.662084 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '38')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:21:20.662164 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '37')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:20.663060 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '38')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:20.663875 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Resulting device map defaultdict(. at 0x76c45057c4a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'): ({'sdi'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:21:20.664106 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Removing multipathed devices sdi, sdh {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:21:20.664908 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Flush multipath device 3300000007a01ed40 {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:21:20.730830 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:20.757810 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Successfully updated port: 0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:21:20.765356 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.663s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:20.771817 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:20.822454 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Received event network-changed-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:20.822567 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Refreshing instance network info cache due to event network-changed-0110b7ff-ae7f-4e02-9493-468035642be2. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:20.822748 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] Acquiring lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:20.824662 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] Acquired lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:20.824662 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Refreshing network info cache for port 0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:20.824662 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:21:20.824662 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:21:20.825357 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:21:20.836597 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:21:20.836807 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:21:20.847855 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:20.851643 np0000004364 nova-compute[98951]: INFO nova.scheduler.client.report [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Deleted allocations for instance 8797c544-317e-4ae4-9a84-512976e3225f Jul 03 04:21:20.878190 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.40.100,3260] Jul 03 04:21:20.878190 np0000004364 nova-compute[98951]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.40.100,3260] successful. Jul 03 04:21:20.878190 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:20.882690 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:21:20.882690 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:20.882690 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] VM Resumed (Lifecycle Event) Jul 03 04:21:20.894394 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:20.907431 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:20.945589 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.50.100,3260] Jul 03 04:21:20.945589 np0000004364 nova-compute[98951]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.50.100,3260] successful. Jul 03 04:21:20.945589 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:20.960495 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:20.960694 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:20.961073 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] <== disconnect_volume: return (335ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:20.961073 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:21:20.963429 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Deleting instance files /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064_del Jul 03 04:21:20.963429 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Deletion of /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064_del complete Jul 03 04:21:21.085770 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:21.086227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:21.086227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:21.086316 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:21.086543 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:21.086762 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:21.259978 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:21.326763 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:21.384286 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:21.388821 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:21.394472 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:21.401549 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:21.401706 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:21.545912 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 683d1775-ad4b-4200-9d1d-ef75e6c95064 could not be found. Jul 03 04:21:21.547023 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:21:21.547465 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:21.547699 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:21.548109 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:21.548583 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:21:21.549237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:21:21.573309 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:21.573309 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:21.573309 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:21.573469 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:21.573469 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:21.573469 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:21.573625 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:21:21.573746 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, 0): [] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:21.574430 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36') {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jul 03 04:21:21.574580 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, 0): [] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:21.574778 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36') {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jul 03 04:21:21.574778 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Resulting device map defaultdict(. at 0x76c450665260>, {}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:21:21.574900 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Disconnecting from: [] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:21:21.575101 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:21.575226 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] <== disconnect_volume: return (27ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:21.575363 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:21:21.584078 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:21.592694 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Took 8.14 seconds to spawn the instance on the hypervisor. Jul 03 04:21:21.592867 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:21.635135 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:21:21.636974 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:21:21.637251 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Creating image(s) Jul 03 04:21:21.637782 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "/opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:21.637955 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "/opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:21.638498 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "/opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:21.639022 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:21.646883 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:21.649583 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:21.738099 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.088s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:21.738501 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:21.738901 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:21.739335 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:21.741834 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:21.742124 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:21.820458 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.078s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:21.820864 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:21.863584 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d3665a3c-8878-4055-86d8-1469d62cf536 tempest-ServerStableDeviceRescueTest-645362785 tempest-ServerStableDeviceRescueTest-645362785-project-member] Lock "8797c544-317e-4ae4-9a84-512976e3225f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.923s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:21.867742 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk 1073741824" returned: 0 in 0.047s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:21.868102 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.129s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:21.868465 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:21.891857 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:21:21.893021 np0000004364 nova-compute[98951]: DEBUG nova.utils [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Queued Task(fn=>, remaining_delay=14.999661211000102 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:21.905519 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'flavor' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:21.956988 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.088s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:21.957353 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:21:21.957568 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:22.043203 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:22.043732 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Cannot resize image /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:21:22.044235 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:21:22.044532 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Ensure instance console log exists: /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:21:22.044920 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:22.045241 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:22.045470 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:22.086510 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-f1df2773-9dbd-4eb8-9123-a728d92013d5 req-24630fdf-ad05-461b-ac7a-d8decd2803b0 service nova] Releasing lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:22.089622 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquired lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:22.089622 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:21:22.109135 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Took 13.90 seconds to build instance. Jul 03 04:21:22.610523 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1b94d056-4de9-4af1-88da-cc11942059d2 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "406bb9c3-ccdd-460d-9219-c6981c4a6f82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.407s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:22.613898 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8bed5d7-bc57-47b7-aab4-4554f08e6294 req-a6fe6f14-67a4-4300-9868-c25aad4acc15 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:22.614187 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8bed5d7-bc57-47b7-aab4-4554f08e6294 req-a6fe6f14-67a4-4300-9868-c25aad4acc15 service nova] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:22.614457 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8bed5d7-bc57-47b7-aab4-4554f08e6294 req-a6fe6f14-67a4-4300-9868-c25aad4acc15 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:22.614629 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-e8bed5d7-bc57-47b7-aab4-4554f08e6294 req-a6fe6f14-67a4-4300-9868-c25aad4acc15 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:22.614800 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-e8bed5d7-bc57-47b7-aab4-4554f08e6294 req-a6fe6f14-67a4-4300-9868-c25aad4acc15 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] No waiting events found dispatching network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:22.614978 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-e8bed5d7-bc57-47b7-aab4-4554f08e6294 req-a6fe6f14-67a4-4300-9868-c25aad4acc15 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received unexpected event network-vif-unplugged-ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6 for instance with vm_state active and task_state rebuilding. Jul 03 04:21:22.667358 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:22.778280 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Preparing to wait for external event volume-reimaged-e6ee881b-4344-4a43-8c3c-d21965282d36 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:21:22.778457 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:22.778836 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:22.779107 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:22.866654 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:22.911817 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:23.003954 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Updating instance_info_cache with network_info: [{"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:23.383116 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.383560 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.383595 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.384103 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.384103 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.384360 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.384698 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.384698 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.384869 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98951) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11412}} Jul 03 04:21:23.385068 np0000004364 nova-compute[98951]: DEBUG oslo_service.periodic_task [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running periodic task ComputeManager.update_available_resource {{(pid=98951) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 04:21:23.505911 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Releasing lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:23.506139 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Instance network_info: |[{"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:21:23.507925 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Start _get_guest_xml network_info=[{"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:21:23.509794 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:21:23.511240 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-921517200', uuid='66d28982-e508-4685-82bb-398e93fb4528'), owner=OwnerMeta(userid='ce282df8d387460b9b69b9e7c4898ba4', username='tempest-AttachVolumeTestJSON-106787617-project-member', projectid='2266213579944d8496ab65c02b49e5d6', projectname='tempest-AttachVolumeTestJSON-106787617'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052483.5107274) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:21:23.512391 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:21:23.512830 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:21:23.513681 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:21:23.513849 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:21:23.514807 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:21:23.515123 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:21:23.515275 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:21:23.515390 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:21:23.515526 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:21:23.515629 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:21:23.515778 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:21:23.515993 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:21:23.516153 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:21:23.516314 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:21:23.516695 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:21:23.516695 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:21:23.539456 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-921517200',display_name='tempest-AttachVolumeTestJSON-server-921517200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachvolumetestjson-server-921517200',id=27,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC6Lrc1mSkFiWPiH1vYry/phUUgQQZMmq8bocAcJOFRlYykF4itlQrWPaLQM1O7gw9agfOHM6Dc+mfN7kGnegpDO1hUHPzmuVSh05zua2AhKwuwE3NAA8ShImQLYBzhoA==',key_name='tempest-keypair-880266472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2266213579944d8496ab65c02b49e5d6',ramdisk_id='',reservation_id='r-ovmnbc6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-106787617',owner_user_name='tempest-AttachVolumeTestJSON-106787617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce282df8d387460b9b69b9e7c4898ba4',uuid=66d28982-e508-4685-82bb-398e93fb4528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:23.539456 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Converting VIF {"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:23.539456 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:9c,bridge_name='br-int',has_traffic_filtering=True,id=0110b7ff-ae7f-4e02-9493-468035642be2,network=Network(26828f81-5a6e-48e9-a332-f9c7547e601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0110b7ff-ae') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:23.540343 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lazy-loading 'pci_devices' on Instance uuid 66d28982-e508-4685-82bb-398e93fb4528 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:23.822454 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Received event network-changed-ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:23.822832 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Refreshing instance network info cache due to event network-changed-ccf07483-3a98-403c-afaf-a944013884fb. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:23.823084 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] Acquiring lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:23.823222 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] Acquired lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:23.823388 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Refreshing network info cache for port ccf07483-3a98-403c-afaf-a944013884fb {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:23.893454 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:23.893454 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:23.893454 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:23.893454 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Auditing locally available compute resources for np0000004364 (node: np0000004364) {{(pid=98951) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jul 03 04:21:24.037678 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:24.037970 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:24.038215 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Attaching volume ebd35f7a-ffca-4456-82ab-90006387117b to /dev/vdb Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] End _get_guest_xml xml= Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 66d28982-e508-4685-82bb-398e93fb4528 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: instance-0000001b Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: tempest-AttachVolumeTestJSON-server-921517200 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 2026-07-03 04:21:23 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: True Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: bare Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: tempest-AttachVolumeTestJSON-106787617-project-member Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: tempest-AttachVolumeTestJSON-106787617 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 66d28982-e508-4685-82bb-398e93fb4528 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 66d28982-e508-4685-82bb-398e93fb4528 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: hvm Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 128 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: Jul 03 04:21:24.043448 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:21:24.045478 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Preparing to wait for external event network-vif-plugged-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:21:24.045478 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Acquiring lock "66d28982-e508-4685-82bb-398e93fb4528-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:24.045478 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "66d28982-e508-4685-82bb-398e93fb4528-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:24.045478 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "66d28982-e508-4685-82bb-398e93fb4528-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:24.045478 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-921517200',display_name='tempest-AttachVolumeTestJSON-server-921517200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-attachvolumetestjson-server-921517200',id=27,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC6Lrc1mSkFiWPiH1vYry/phUUgQQZMmq8bocAcJOFRlYykF4itlQrWPaLQM1O7gw9agfOHM6Dc+mfN7kGnegpDO1hUHPzmuVSh05zua2AhKwuwE3NAA8ShImQLYBzhoA==',key_name='tempest-keypair-880266472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2266213579944d8496ab65c02b49e5d6',ramdisk_id='',reservation_id='r-ovmnbc6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-106787617',owner_user_name='tempest-AttachVolumeTestJSON-106787617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce282df8d387460b9b69b9e7c4898ba4',uuid=66d28982-e508-4685-82bb-398e93fb4528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:21:24.045673 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Converting VIF {"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:24.046160 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:9c,bridge_name='br-int',has_traffic_filtering=True,id=0110b7ff-ae7f-4e02-9493-468035642be2,network=Network(26828f81-5a6e-48e9-a332-f9c7547e601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0110b7ff-ae') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:24.046508 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:9c,bridge_name='br-int',has_traffic_filtering=True,id=0110b7ff-ae7f-4e02-9493-468035642be2,network=Network(26828f81-5a6e-48e9-a332-f9c7547e601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0110b7ff-ae') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:21:24.047078 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:24.047510 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:24.047784 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:21:24.049033 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:24.049240 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01a0ba23-8066-50bf-9213-406fb36cecb7', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:24.050065 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:24.050986 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:24.053150 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:24.053374 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0110b7ff-ae, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:24.053780 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0110b7ff-ae, col_values=(('qos', UUID('920c4408-b564-409d-94ff-ac9c3ecab0de')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:24.054263 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0110b7ff-ae, col_values=(('external_ids', {'iface-id': '0110b7ff-ae7f-4e02-9493-468035642be2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:fd:9c', 'vm-uuid': '66d28982-e508-4685-82bb-398e93fb4528'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:24.058011 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:24.059509 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:24.065651 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:24.066691 np0000004364 nova-compute[98951]: INFO os_vif [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fd:9c,bridge_name='br-int',has_traffic_filtering=True,id=0110b7ff-ae7f-4e02-9493-468035642be2,network=Network(26828f81-5a6e-48e9-a332-f9c7547e601d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0110b7ff-ae') Jul 03 04:21:24.095787 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:24.108200 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:21:24.130951 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:24.169708 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:21:24.171128 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:21:24.179498 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:21:24.181986 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fea6:74be', 'fe80::483:4eff:fe06:c0d8', 'fe80::c95:f2ff:fea6:c330', 'fe80::fc16:3eff:fe42:305c', 'fe80::fc16:3eff:fe83:2099', 'fe80::fc16:3eff:fe85:7f41', 'fe80::fc16:3eff:fef3:9f4c', 'fe80::cc6:76ff:fe4d:caf7', 'fe80::fc16:3eff:fe92:2d83', 'fe80::fc16:3eff:fe56:54d6', 'fe80::fc16:3eff:fea5:865b', 'fe80::94ce:15ff:febc:f9da', 'fe80::fc16:3eff:fed8:864b', 'fe80::588c:8dff:fe99:8e86', 'fe80::fc16:3eff:fe8e:c522'] Jul 03 04:21:24.182143 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:21:24.182236 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:21:24.185529 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:24.185529 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Updating existing volume attachment record: 45bb023f-79c1-47d1-9365-6f6055e2f88c {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:21:24.326099 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:24.719075 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:24.759098 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:21:24.759522 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebd35f7a-ffca-4456-82ab-90006387117b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:24.759666 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:24.869680 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updated VIF entry in instance network info cache for port ccf07483-3a98-403c-afaf-a944013884fb. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:21:24.870003 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] [instance: 337a804b-18df-468c-ae55-d67ca3d7dbd5] Updating instance_info_cache with network_info: [{"id": "ccf07483-3a98-403c-afaf-a944013884fb", "address": "fa:16:3e:85:7f:41", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf07483-3a", "ovs_interfaceid": "ccf07483-3a98-403c-afaf-a944013884fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:24.949231 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.044260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.044260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.148508 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047087f9-9dc6-43a6-a27b-027548780341/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.153958 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98951) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12400}} Jul 03 04:21:25.159648 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.204303 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:25.274423 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.275827 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.359035 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:25.361726 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7a3727c-3c5e-4296-80c1-8098dd672b3e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.365407 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.377814 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a8a552b7-22bd-4d67-9955-97a328d8a8cd req-8cc3a7fd-bbce-4689-944c-0c4d262da792 service nova] Releasing lock "refresh_cache-337a804b-18df-468c-ae55-d67ca3d7dbd5" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:25.390297 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:25.390687 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:25.455799 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.456210 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.542664 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/406bb9c3-ccdd-460d-9219-c6981c4a6f82/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.546741 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.597104 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:25.597291 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:25.597475 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] No VIF found with MAC fa:16:3e:52:fd:9c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:25.598279 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Using config drive Jul 03 04:21:25.653913 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json" returned: 0 in 0.107s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.654412 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.738794 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk.rescue --force-share --output=json" returned: 0 in 0.084s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.739351 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.825834 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.826612 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:25.897354 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Starting instance... {{(pid=98951) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}} Jul 03 04:21:25.906537 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Received event network-changed-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:25.906537 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Refreshing instance network info cache due to event network-changed-73eca3e4-62a9-4cc6-89fb-3e41299e197f. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:25.906537 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] Acquiring lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:25.906537 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] Acquired lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:25.906537 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Refreshing network info cache for port 73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:25.930998 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991be57-007c-4b9b-9d28-b80d662100a9/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:25.936354 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.022174 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.023003 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.111863 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:26.113906 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b38f9111-bf01-40bd-ae5e-873de4cb90f3/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.119886 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.212868 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.213873 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.232081 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.470s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:26.234617 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebd35f7a-ffca-4456-82ab-90006387117b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:21:26.252049 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:26.253133 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:26.253380 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:21:26.254141 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:26.254808 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:26.257340 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:21:26.264163 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:21:26.264163 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:26.268629 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:21:26.268629 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b] added Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:26.277944 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:26.278493 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:21:26.278493 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:21:26.278642 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b] added Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:26.281433 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:26.281842 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:21:26.281842 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:21:26.282084 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:21:26.304577 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Creating config drive at /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk.config Jul 03 04:21:26.308913 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdoqmouhb {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.319479 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7760c72-db16-418b-b3b8-84fab8054f20/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.326768 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.358349 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66d28982-e508-4685-82bb-398e93fb4528/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdoqmouhb" returned: 0 in 0.047s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.417824 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:26.444628 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.445164 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.514074 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:26.514504 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:26.522303 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98951) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jul 03 04:21:26.523184 np0000004364 nova-compute[98951]: INFO nova.compute.claims [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Claim successful on node np0000004364 Jul 03 04:21:26.542248 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.545057 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.641480 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.641961 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.730358 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337a804b-18df-468c-ae55-d67ca3d7dbd5/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.735990 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:21:26.737709 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:26.784901 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:26.787163 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Hypervisor/Node resource view: name=np0000004364 free_ram=49543MB free_disk=74.01247787475586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}] {{(pid=98951) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jul 03 04:21:26.787163 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:26.837720 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:26.886619 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:26.889910 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:26.975340 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:27.097797 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Updated VIF entry in instance network info cache for port 73eca3e4-62a9-4cc6-89fb-3e41299e197f. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:21:27.098585 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Updating instance_info_cache with network_info: [{"id": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "address": "fa:16:3e:8e:c5:22", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73eca3e4-62", "ovs_interfaceid": "73eca3e4-62a9-4cc6-89fb-3e41299e197f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:27.228780 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:27.238585 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:27.262310 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:27.279824 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:21:27.282397 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:21:27.292288 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:21:27.299981 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.308793 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.314805 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.324619 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.324619 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.324619 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.324619 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.324619 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:27.324859 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.324859 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.324859 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.324859 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.324859 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.330546 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:27.368950 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.50.100,3260] Jul 03 04:21:27.368950 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.50.100,3260] successful. Jul 03 04:21:27.368950 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.376598 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.40.100,3260] Jul 03 04:21:27.376598 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.40.100,3260] successful. Jul 03 04:21:27.376598 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.388796 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.393211 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.410220 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.410479 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.410896 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:27.411096 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:27.411404 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:27.411524 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:21:27.411933 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:27.412092 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:21:27.413141 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] HCTL ('11', '-', '-', 0) found on session 43 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:21:27.413259 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:21:27.414565 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] HCTL ('12', '-', '-', 0) found on session 44 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:21:27.414732 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:21:27.429759 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Searching for a device in session 43 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:21:27.429759 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ebd35f7a-ffca-4456-82ab-90006387117b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:21:27.439265 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Searching for a device in session 44 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:21:27.439265 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebd35f7a-ffca-4456-82ab-90006387117b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:21:27.602085 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-76ada601-71ce-46d6-bf67-029a1a9ae4c5 req-74de7b35-ea62-4182-8348-726683b2c5e2 service nova] Releasing lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:27.743484 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:27.743594 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] VM Started (Lifecycle Event) Jul 03 04:21:27.971119 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Received event network-vif-plugged-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] Acquiring lock "66d28982-e508-4685-82bb-398e93fb4528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] Lock "66d28982-e508-4685-82bb-398e93fb4528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] Lock "66d28982-e508-4685-82bb-398e93fb4528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Processing event network-vif-plugged-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Received event network-vif-plugged-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] Acquiring lock "66d28982-e508-4685-82bb-398e93fb4528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] Lock "66d28982-e508-4685-82bb-398e93fb4528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] Lock "66d28982-e508-4685-82bb-398e93fb4528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] No waiting events found dispatching network-vif-plugged-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-322a8347-681d-4a70-92ee-af92f3416d48 req-ed9f76f7-28ca-4234-9b3d-9e09b96b024c service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Received unexpected event network-vif-plugged-0110b7ff-ae7f-4e02-9493-468035642be2 for instance with vm_state building and task_state spawning. Jul 03 04:21:27.974263 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:21:27.977873 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:21:27.978790 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Instance spawned successfully. Jul 03 04:21:27.979087 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:21:28.137544 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:21:28.137834 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:21:28.246057 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:28.249791 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:28.255320 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:21:28.488227 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:28.488380 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:28.488616 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:28.488841 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:28.489086 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:28.489317 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:28.640622 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:21:28.752593 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:21:28.752750 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:28.752820 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] VM Paused (Lifecycle Event) Jul 03 04:21:28.993893 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Took 7.36 seconds to spawn the instance on the hypervisor. Jul 03 04:21:28.994433 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:29.060662 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:29.146497 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.632s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:29.147075 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.361s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:29.147737 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Start building networks asynchronously for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3010}} Jul 03 04:21:29.255248 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:29.259251 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:29.259476 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] VM Resumed (Lifecycle Event) Jul 03 04:21:29.272098 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Found WWN 330000000ce71148c for multipath device dm-6 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:21:29.272442 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:29.272632 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] <== connect_volume: return (4512ms) {'type': 'block', 'scsi_wwn': '330000000ce71148c', 'path': '/dev/dm-6', 'multipath_id': '330000000ce71148c'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:29.272741 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce71148c', 'path': '/dev/dm-6', 'multipath_id': '330000000ce71148c'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:21:29.275243 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'flavor' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:29.501836 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Took 13.14 seconds to build instance. Jul 03 04:21:29.654158 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Allocating IP information in the background. {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2155}} Jul 03 04:21:29.654451 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] allocate_for_instance() {{(pid=98951) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jul 03 04:21:29.654756 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:29.655076 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:29.741142 np0000004364 nova-compute[98951]: DEBUG nova.policy [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18cf98c1da954ad0bdb32a5854b3ba36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9de1e5af73b486dbece4a569eeaaa68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98951) authorize /opt/stack/nova/nova/policy.py:192}} Jul 03 04:21:29.762277 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:29.764396 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:29.779291 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Attempting to attach volume ebd35f7a-ffca-4456-82ab-90006387117b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98951) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2322}} Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] attach device xml: Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: ebd35f7a-ffca-4456-82ab-90006387117b Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: Jul 03 04:21:29.781210 np0000004364 nova-compute[98951]: {{(pid=98951) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jul 03 04:21:29.781647 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0008359500000096887 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:29.781759 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:29.781881 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.110749118000058 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:29.781962 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.110664183000154 future=) {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:29.782440 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:29.782510 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] VM Stopped (Lifecycle Event) Jul 03 04:21:30.003257 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-fe49698f-506b-4127-addb-f4b6b42caef8 tempest-AttachVolumeTestJSON-106787617 tempest-AttachVolumeTestJSON-106787617-project-member] Lock "66d28982-e508-4685-82bb-398e93fb4528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.645s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:30.158412 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jul 03 04:21:30.251260 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 92676c92-4e10-44e8-be59-269fd72a616e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.251260 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 5fb1dfd1-a0bc-42d0-8a53-c1662fe7e995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.251260 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b991be57-007c-4b9b-9d28-b80d662100a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.251260 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b38f9111-bf01-40bd-ae5e-873de4cb90f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.251427 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 683d1775-ad4b-4200-9d1d-ef75e6c95064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.254387 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 337a804b-18df-468c-ae55-d67ca3d7dbd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.254519 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance c7760c72-db16-418b-b3b8-84fab8054f20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.254659 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 047087f9-9dc6-43a6-a27b-027548780341 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.254822 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance d7a3727c-3c5e-4296-80c1-8098dd672b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.254945 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 406bb9c3-ccdd-460d-9219-c6981c4a6f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.255123 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance 66d28982-e508-4685-82bb-398e93fb4528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.257996 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Instance b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98951) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jul 03 04:21:30.257996 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jul 03 04:21:30.257996 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Final resource view: name=np0000004364 phys_ram=64301MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:21:26 up 29 min, 2 users, load average: 11.18, 6.82, 3.22\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '11', 'num_os_type_None': '12', 'num_proj_f9de1e5af73b486dbece4a569eeaaa68': '5', 'io_workload': '2', 'num_proj_82604b4949eb47659d954def4e326795': '3', 'num_vm_rescued': '1', 'num_proj_470ce7b097604ff79ffa0835affde06b': '1', 'num_proj_e238c107920c40139ecebfc8bed78991': '1', 'num_proj_2266213579944d8496ab65c02b49e5d6': '1', 'num_vm_building': '1', 'num_task_rebuilding': '1', 'num_proj_b2f692daeca94508859887b79b6f1ab3': '1'} {{(pid=98951) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jul 03 04:21:30.265115 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Successfully created port: 31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jul 03 04:21:30.288427 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-c2352698-8948-4068-8b60-99af14cfddf0 None None] [instance: 8797c544-317e-4ae4-9a84-512976e3225f] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:30.363970 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:30.661318 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Start building block device mappings for instance. {{(pid=98951) _build_resources /opt/stack/nova/nova/compute/manager.py:3045}} Jul 03 04:21:30.958102 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Successfully updated port: 31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jul 03 04:21:30.995101 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98951) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:10018}} Jul 03 04:21:30.995427 np0000004364 nova-compute[98951]: DEBUG nova.compute.provider_tree [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed in ProviderTree for provider: 1a5251c8-01ca-4243-8d62-6cfdc308a824 {{(pid=98951) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jul 03 04:21:31.031785 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Received event network-changed-31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:31.032158 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Refreshing instance network info cache due to event network-changed-31a5c6e3-b7ef-4aeb-93a3-7732b923374b. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:31.032212 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] Acquiring lock "refresh_cache-b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:31.032867 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] Acquired lock "refresh_cache-b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:31.033337 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Refreshing network info cache for port 31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:31.038163 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-24357c59-614b-4015-b524-6b71a833f387 req-faf398a5-8a63-4030-b0b0-d2c131d7afb9 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Received event volume-reimaged-e6ee881b-4344-4a43-8c3c-d21965282d36 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:31.039319 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-24357c59-614b-4015-b524-6b71a833f387 req-faf398a5-8a63-4030-b0b0-d2c131d7afb9 service nova] Acquiring lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:31.039670 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-24357c59-614b-4015-b524-6b71a833f387 req-faf398a5-8a63-4030-b0b0-d2c131d7afb9 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:31.040188 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-24357c59-614b-4015-b524-6b71a833f387 req-faf398a5-8a63-4030-b0b0-d2c131d7afb9 service nova] Lock "683d1775-ad4b-4200-9d1d-ef75e6c95064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:31.040188 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-24357c59-614b-4015-b524-6b71a833f387 req-faf398a5-8a63-4030-b0b0-d2c131d7afb9 service nova] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Processing event volume-reimaged-e6ee881b-4344-4a43-8c3c-d21965282d36 {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:21:31.041011 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Instance event wait completed in 8 seconds for volume-reimaged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:21:31.268224 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Received event network-changed-0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:31.268955 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Refreshing instance network info cache due to event network-changed-0110b7ff-ae7f-4e02-9493-468035642be2. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:31.269070 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] Acquiring lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:31.269213 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] Acquired lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:31.269404 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Refreshing network info cache for port 0110b7ff-ae7f-4e02-9493-468035642be2 {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:31.447837 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:31.448159 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:31.448237 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] No VIF found with MAC fa:16:3e:f3:9f:4c, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:31.461314 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "refresh_cache-b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:31.498154 np0000004364 nova-compute[98951]: DEBUG nova.scheduler.client.report [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Inventory has not changed for provider 1a5251c8-01ca-4243-8d62-6cfdc308a824 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98951) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}} Jul 03 04:21:31.539286 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:31.545560 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Booting with volume e6ee881b-4344-4a43-8c3c-d21965282d36 at /dev/vda Jul 03 04:21:31.603267 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.253', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000004364', 'execute': None}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:31.616742 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.scaleio [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98951) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 04:21:31.633911 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:31.641629 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Running cmd (subprocess): nvme version {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:31.674054 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Start spawning the instance on the hypervisor. {{(pid=98951) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2818}} Jul 03 04:21:31.675898 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:21:31.676157 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Creating image(s) Jul 03 04:21:31.676931 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "/opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:31.677255 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:31.677936 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "/opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:31.683198 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:31.687223 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:31.690733 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:31.706260 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] 'nvme version' failed. Not Retrying. {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 04:21:31.706834 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] nvme not present on system {{(pid=98951) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 04:21:31.716920 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98951) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 04:21:31.719544 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.lightos [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Current host hostNQN and IP(s) are ['10.4.3.253', 'fe80::f816:3eff:fef9:a351', '192.168.40.6', 'fe80::f816:3eff:fe7c:1049', '192.168.50.6', 'fe80::f816:3eff:fe3c:22c1', '192.168.10.6', 'fe80::f816:3eff:fe24:9837', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::1019:cfff:fe88:394b', 'fe80::fc16:3eff:fea6:74be', 'fe80::483:4eff:fe06:c0d8', 'fe80::c95:f2ff:fea6:c330', 'fe80::fc16:3eff:fe42:305c', 'fe80::fc16:3eff:fe83:2099', 'fe80::fc16:3eff:fe85:7f41', 'fe80::fc16:3eff:fef3:9f4c', 'fe80::cc6:76ff:fe4d:caf7', 'fe80::fc16:3eff:fe92:2d83', 'fe80::fc16:3eff:fe56:54d6', 'fe80::fc16:3eff:fea5:865b', 'fe80::94ce:15ff:febc:f9da', 'fe80::fc16:3eff:fed8:864b', 'fe80::588c:8dff:fe99:8e86', 'fe80::fc16:3eff:fe8e:c522', 'fe80::fc16:3eff:fe52:fd9c', 'fe80::100e:7bff:fe46:f348'] Jul 03 04:21:31.719775 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 04:21:31.719985 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.lightos [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] LIGHTOS: no hostnqn found. {{(pid=98951) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 04:21:31.720520 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.253', 'host': 'np0000004364', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:5d2b6bd8750', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '190aeeb9-2544-4e04-93ad-068acb5ab197', 'nvme_native_multipath': False} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:31.721023 np0000004364 nova-compute[98951]: DEBUG nova.virt.block_device [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Updating existing volume attachment record: cf79bf55-b0c5-48f1-8de8-31a77736a5c6 {{(pid=98951) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jul 03 04:21:31.777267 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:31.803352 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.113s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:31.804099 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:31.804767 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:31.808354 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:31.810907 np0000004364 nova-compute[98951]: DEBUG oslo_utils.imageutils.format_inspector [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98951) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jul 03 04:21:31.811653 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:31.922880 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.111s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:31.926072 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk 1073741824 {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:31.981847 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97,backing_fmt=raw /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk 1073741824" returned: 0 in 0.056s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:31.982399 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "ed2eea7c9016720d487cb906ac8c8e479fe43b97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.178s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:31.983056 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:32.008807 np0000004364 nova-compute[98951]: DEBUG nova.compute.resource_tracker [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Compute_service record updated for np0000004364:np0000004364 {{(pid=98951) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jul 03 04:21:32.009259 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.863s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:32.010587 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [None req-49eb04d3-8012-4f5b-9a63-446b372a91fa None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:21:32.067413 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed2eea7c9016720d487cb906ac8c8e479fe43b97 --force-share --output=json" returned: 0 in 0.084s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:32.068595 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk. size=1073741824 {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jul 03 04:21:32.068916 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk --force-share --output=json {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:32.162268 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:32.162917 np0000004364 nova-compute[98951]: DEBUG nova.virt.disk.api [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Cannot resize image /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk to a smaller size. {{(pid=98951) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jul 03 04:21:32.163672 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Created local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jul 03 04:21:32.163882 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Ensure instance console log exists: /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:21:32.164233 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:32.164494 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:32.164822 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:32.248831 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:32.409692 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Updated VIF entry in instance network info cache for port 0110b7ff-ae7f-4e02-9493-468035642be2. {{(pid=98951) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}} Jul 03 04:21:32.410028 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] [instance: 66d28982-e508-4685-82bb-398e93fb4528] Updating instance_info_cache with network_info: [{"id": "0110b7ff-ae7f-4e02-9493-468035642be2", "address": "fa:16:3e:52:fd:9c", "network": {"id": "26828f81-5a6e-48e9-a332-f9c7547e601d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1365310783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2266213579944d8496ab65c02b49e5d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0110b7ff-ae", "ovs_interfaceid": "0110b7ff-ae7f-4e02-9493-468035642be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:32.441667 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Updating instance_info_cache with network_info: [] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:32.912138 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-4d9fc172-fc56-4e9a-93c3-5a264efbd6b7 req-c2c96abc-9964-463d-90e1-666f1952f9b3 service nova] Releasing lock "refresh_cache-66d28982-e508-4685-82bb-398e93fb4528" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:32.944050 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-a9c64743-8dc2-4c28-9dc0-b46ac70ed70f req-7c7487c8-1b70-4a65-9a23-29d35d83b02c service nova] Releasing lock "refresh_cache-b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:32.944428 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquired lock "refresh_cache-b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:32.944634 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Building network info cache for instance {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jul 03 04:21:33.021223 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-52dae35a-3efe-4c6f-aad9-c09511e37226 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.982s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:33.519788 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Instance cache missing network info. {{(pid=98951) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}} Jul 03 04:21:33.677105 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:33.818559 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Updating instance_info_cache with network_info: [{"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98951) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jul 03 04:21:33.847273 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Creating instance directory {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5223}} Jul 03 04:21:33.847534 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Creating image(s) Jul 03 04:21:33.847837 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Did not create local disks {{(pid=98951) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5367}} Jul 03 04:21:33.847959 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Ensure instance console log exists: /opt/stack/data/nova/instances/683d1775-ad4b-4200-9d1d-ef75e6c95064/console.log {{(pid=98951) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5102}} Jul 03 04:21:33.848234 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:33.848435 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:33.848585 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:33.849092 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Start _get_guest_xml network_info=[{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-07-03T04:15:35Z,direct_url=,disk_format='qcow2',id=ec5f9610-ac5b-441b-b0d5-db3559298a7e,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-07-03T04:15:38Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'cf79bf55-b0c5-48f1-8de8-31a77736a5c6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '683d1775-ad4b-4200-9d1d-ef75e6c95064', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'serial': 'e6ee881b-4344-4a43-8c3c-d21965282d36'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:21:33.853788 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jul 03 04:21:33.853943 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='ec5f9610-ac5b-441b-b0d5-db3559298a7e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1923207365', uuid='683d1775-ad4b-4200-9d1d-ef75e6c95064'), owner=OwnerMeta(userid='2ca140c204734e4fbf4eda5377f08fe7', username='tempest-ServerActionsV293TestJSON-223165141-project-member', projectid='b2f692daeca94508859887b79b6f1ab3', projectname='tempest-ServerActionsV293TestJSON-223165141'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052493.8534877) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:21:33.855502 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:21:33.856011 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:21:33.856700 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:21:33.856879 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:21:33.858833 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:21:33.858833 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-07-03T04:15:35Z,direct_url=,disk_format='qcow2',id=ec5f9610-ac5b-441b-b0d5-db3559298a7e,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-07-03T04:15:38Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:21:33.858833 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:21:33.858833 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:21:33.858833 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:21:33.858833 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:21:33.859066 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:21:33.859066 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:21:33.859113 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:21:33.859219 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:21:33.859318 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:21:33.859615 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:21:33.859615 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 683d1775-ad4b-4200-9d1d-ef75e6c95064 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:34.066689 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.320678 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Releasing lock "refresh_cache-b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 04:21:34.320999 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Instance network_info: |[{"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98951) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2170}} Jul 03 04:21:34.322570 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Start _get_guest_xml network_info=[{"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '60fe5a74-ce6e-4c15-8d86-83089993b0d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8212}} Jul 03 04:21:34.324853 np0000004364 nova-compute[98951]: WARNING nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jul 03 04:21:34.325810 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc'), owner=OwnerMeta(userid='18cf98c1da954ad0bdb32a5854b3ba36', username='tempest-AttachVolumeMultiAttachTest-1445524669-project-member', projectid='f9de1e5af73b486dbece4a569eeaaa68', projectname='tempest-AttachVolumeMultiAttachTest-1445524669'), image=ImageMeta(id='60fe5a74-ce6e-4c15-8d86-83089993b0d3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1783052494.3255315) {{(pid=98951) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jul 03 04:21:34.326754 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V1... {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jul 03 04:21:34.327114 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller missing on host. {{(pid=98951) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jul 03 04:21:34.327859 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Searching host: 'np0000004364' for CPU controller through CGroups V2... {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jul 03 04:21:34.328000 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.host [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU controller found on host. {{(pid=98951) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jul 03 04:21:34.328760 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98951) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5904}} Jul 03 04:21:34.328986 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-07-03T04:15:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-07-03T04:15:39Z,direct_url=,disk_format='qcow2',id=60fe5a74-ce6e-4c15-8d86-83089993b0d3,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='d86e2d8b22ab4fd2846de4d7b56148e7',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-07-03T04:15:41Z,virtual_size=,visibility=), allow threads: True {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jul 03 04:21:34.329121 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jul 03 04:21:34.329189 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image limits 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jul 03 04:21:34.329304 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Flavor pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jul 03 04:21:34.329415 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Image pref 0:0:0 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jul 03 04:21:34.329546 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jul 03 04:21:34.329717 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jul 03 04:21:34.329812 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jul 03 04:21:34.329909 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Got 1 possible topologies {{(pid=98951) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jul 03 04:21:34.330000 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jul 03 04:21:34.330125 np0000004364 nova-compute[98951]: DEBUG nova.virt.hardware [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98951) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jul 03 04:21:34.342192 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-1',id=28,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-e84ldaro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:34.342433 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:34.342923 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=31a5c6e3-b7ef-4aeb-93a3-7732b923374b,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a5c6e3-b7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:34.343395 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lazy-loading 'pci_devices' on Instance uuid b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:34.372004 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Calling os-brick to attach iSCSI Volume {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jul 03 04:21:34.372467 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:34.372602 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:34.373056 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:34.373412 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 04:21:34.384591 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:34.385041 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:34.385457 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:34.385641 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:21:34.386237 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:34.386458 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:21:34.396613 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:21:34.396613 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:34.401878 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 04:21:34.401878 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36] added Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:34.409827 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:34.410142 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:21:34.410142 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:21:34.410274 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36] added Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: iscsiadm: Config file line 363 does not have value Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 04:21:34.414313 np0000004364 nova-compute[98951]: {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:34.414650 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98951) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 04:21:34.414650 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 04:21:34.414763 np0000004364 nova-compute[98951]: DEBUG os_brick.utils [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98951) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] End _get_guest_xml xml= Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: instance-0000001c Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: multiattach-server-1 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 2026-07-03 04:21:34 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: True Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: bare Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669-project-member Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: tempest-AttachVolumeMultiAttachTest-1445524669 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: hvm Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 128 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: Jul 03 04:21:34.846049 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Preparing to wait for external event network-vif-plugged-31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Acquiring lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-07-03T04:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='multiattach-server-1',id=28,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJIcpRl72vbyyLwyNwak+5luyM1FZq9GB1lGiK+tAxaDmAC9sIHgGHKsRDb04xqIYUsEXEMeIyvh5jbI294c5s3M1k6VNGE1A1H5A/eMXBvTH3fb837iHgTT6a6KLETsw==',key_name='tempest-keypair-680310075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9de1e5af73b486dbece4a569eeaaa68',ramdisk_id='',reservation_id='r-e84ldaro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1445524669',owner_user_name='tempest-AttachVolumeMultiAttachTest-1445524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18cf98c1da954ad0bdb32a5854b3ba36',uuid=b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converting VIF {"id": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "address": "fa:16:3e:68:f4:2a", "network": {"id": "497654c9-107e-44fc-81da-d004d975e448", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1354156352-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9de1e5af73b486dbece4a569eeaaa68", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a5c6e3-b7", "ovs_interfaceid": "31a5c6e3-b7ef-4aeb-93a3-7732b923374b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=31a5c6e3-b7ef-4aeb-93a3-7732b923374b,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a5c6e3-b7') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=31a5c6e3-b7ef-4aeb-93a3-7732b923374b,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a5c6e3-b7') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:21:34.848492 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.848918 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:34.849160 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:21:34.850142 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.850312 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee82bbc2-91de-5aef-b106-74265684460c', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:34.853056 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.853056 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:34.854916 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.855079 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31a5c6e3-b7, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:34.855445 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31a5c6e3-b7, col_values=(('qos', UUID('86796751-a5c5-4810-b617-37854078fd1e')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:34.855623 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31a5c6e3-b7, col_values=(('external_ids', {'iface-id': '31a5c6e3-b7ef-4aeb-93a3-7732b923374b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f4:2a', 'vm-uuid': 'b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:34.856397 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.857636 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:34.862710 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:34.863187 np0000004364 nova-compute[98951]: INFO os_vif [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=31a5c6e3-b7ef-4aeb-93a3-7732b923374b,network=Network(497654c9-107e-44fc-81da-d004d975e448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a5c6e3-b7') Jul 03 04:21:35.217391 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "c7760c72-db16-418b-b3b8-84fab8054f20" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:35.217669 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:35.364921 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:35.410669 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 04:21:35.414995 np0000004364 nova-compute[98951]: INFO os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.40.100 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:21:35.423557 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.name = iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.tpgt = -1 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.startup = manual Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.leading_login = No Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.iscsi_ifacename = default Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.net_ifacename = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.ipaddress = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.prefix_len = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.hwaddress = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.transport_name = tcp Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.initiatorname = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.vlan_id = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.vlan_priority = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.vlan_state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.iface_num = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.mtu = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.port = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.bootproto = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.subnet_mask = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.gateway = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id_state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_alt_client_id = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_dns = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_learn_iqn = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_req_vendor_id_state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id_state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_vendor_id = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.dhcp_slp_da = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.fragmentation = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.gratuitous_arp = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.incoming_forwarding = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tos_state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tos = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.ttl = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.delayed_ack = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tcp_nagle = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tcp_wsf_state = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tcp_wsf = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tcp_timer_scale = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.tcp_timestamp = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.redirect = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.def_task_mgmt_timeout = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.header_digest = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.data_digest = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.immediate_data = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.initial_r2t = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.data_seq_inorder = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.data_pdu_inorder = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.erl = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.max_receive_data_len = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.first_burst_len = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.max_outstanding_r2t = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.max_burst_len = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.chap_auth = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.bidi_chap = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.strict_login_compliance = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.discovery_auth = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: iface.discovery_logout = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.discovery_address = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.discovery_port = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.discovery_type = fw Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.initial_cmdsn = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.initial_login_retry_max = 8 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.xmit_thread_priority = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.cmds_max = 128 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.queue_depth = 32 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.nr_sessions = 1 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.auth.authmethod = None Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.auth.username = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.auth.password = *** Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.auth.username_in = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.auth.password_in = Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.auth.chap_algs = SHA256 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.timeo.replacement_timeout = 120 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.err_timeo.abort_timeout = 15 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.FastAbort = Yes Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.InitialR2T = No Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.ImmediateData = Yes Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.MaxConnections = 1 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.iscsi.ERL = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.scan = auto Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.session.reopen_max = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].address = 192.168.50.100 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].port = 3260 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].startup = manual Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].tcp.window_size = 524288 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].tcp.type_of_service = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].timeo.logout_timeout = 15 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].timeo.login_timeout = 15 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].timeo.auth_timeout = 45 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].iscsi.HeaderDigest = None Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].iscsi.DataDigest = None Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].iscsi.IFMarker = No Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: node.conn[0].iscsi.OFMarker = No Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: # END RECORD Jul 03 04:21:35.425545 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.435656 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.441253 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.451664 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.451664 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.451664 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.451664 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.451664 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:35.451895 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.451895 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.451895 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.451895 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.451895 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:35.457652 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.457652 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.457652 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.457652 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.457652 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:35.457830 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.457830 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.457830 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.457830 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.457830 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:35.488003 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.40.100,3260] Jul 03 04:21:35.488003 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.40.100,3260] successful. Jul 03 04:21:35.488003 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.498316 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.50.100,3260] Jul 03 04:21:35.498316 np0000004364 nova-compute[98951]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36, portal: 192.168.50.100,3260] successful. Jul 03 04:21:35.498316 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.505421 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.514354 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.522347 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.522745 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:35.523010 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:35.523010 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to 192.168.40.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:21:35.524192 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] HCTL ('7', '-', '-', 0) found on session 45 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:21:35.524192 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to 192.168.50.100:3260 {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] HCTL ('8', '-', '-', 0) found on session 46 with lun 0 {{(pid=98951) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 04:21:35.532195 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98951) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 04:21:35.540134 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 45 and hctl ['7', '*', '*', 0] yield: None {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:21:35.550307 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 46 and hctl ['8', '*', '*', 0] yield: None {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:21:35.720155 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Detaching volume ebd35f7a-ffca-4456-82ab-90006387117b Jul 03 04:21:35.783099 np0000004364 nova-compute[98951]: INFO nova.virt.block_device [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Attempting to driver detach volume ebd35f7a-ffca-4456-82ab-90006387117b from mountpoint /dev/vdb Jul 03 04:21:35.787826 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Found disk vdb by alias ua-ebd35f7a-ffca-4456-82ab-90006387117b {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:21:35.790088 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Found disk vdb by alias ua-ebd35f7a-ffca-4456-82ab-90006387117b {{(pid=98951) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2884}} Jul 03 04:21:35.790394 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Attempting to detach device vdb from instance c7760c72-db16-418b-b3b8-84fab8054f20 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] detach device xml: Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: ebd35f7a-ffca-4456-82ab-90006387117b Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]:
Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: Jul 03 04:21:35.790790 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:35.800499 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Successfully detached device vdb from instance c7760c72-db16-418b-b3b8-84fab8054f20 from the persistent domain config. Jul 03 04:21:35.800819 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] (1/8): Attempting to detach device vdb with device alias ua-ebd35f7a-ffca-4456-82ab-90006387117b from instance c7760c72-db16-418b-b3b8-84fab8054f20 from the live domain config. {{(pid=98951) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2668}} Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] detach device xml: Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: ebd35f7a-ffca-4456-82ab-90006387117b Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]:
Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: Jul 03 04:21:35.801211 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:36.299249 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Received event ua-ebd35f7a-ffca-4456-82ab-90006387117b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98951) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2521}} Jul 03 04:21:36.300642 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ebd35f7a-ffca-4456-82ab-90006387117b for instance c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2748}} Jul 03 04:21:36.302759 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Successfully detached device vdb from instance c7760c72-db16-418b-b3b8-84fab8054f20 from the live domain config. Jul 03 04:21:36.303568 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] calling os-brick to detach iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jul 03 04:21:36.303828 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebd35f7a-ffca-4456-82ab-90006387117b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 04:21:36.303971 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 04:21:36.376835 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:36.376835 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:36.376991 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] No VIF found with MAC fa:16:3e:68:f4:2a, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:36.377509 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Using config drive Jul 03 04:21:36.538773 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 45 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:21:36.538985 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:21:36.548530 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Searching for a device in session 46 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98951) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 04:21:36.548668 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6ee881b-4344-4a43-8c3c-d21965282d36', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98951) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 04:21:36.883795 np0000004364 nova-compute[98951]: WARNING neutronclient.v2_0.client [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jul 03 04:21:36.893185 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005148359998656815 future=) submitted to {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:36.893317 np0000004364 nova-compute[98951]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98951) _log /opt/stack/nova/nova/utils.py:1508}} Jul 03 04:21:36.893912 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Emitting event Stopped> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:36.894115 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] VM Stopped (Lifecycle Event) Jul 03 04:21:37.060353 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Creating config drive at /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk.config Jul 03 04:21:37.065298 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdrlqlaum {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 04:21:37.114876 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.processutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdrlqlaum" returned: 0 in 0.049s {{(pid=98951) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 04:21:37.386647 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jul 03 04:21:37.397141 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-e6a83d78-7851-4e88-bc50-8992ad733df5 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:37.538300 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:37.582885 np0000004364 nova-compute[98951]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98951) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jul 03 04:21:37.587253 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:37.588922 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:37.666351 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:37.725277 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:37.726633 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:37.789832 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-30b330d6-c357-4a01-8813-54603361a76e req-b1d25baf-0258-439a-9a94-09000c55d2c6 service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Received event network-vif-plugged-31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:37.790196 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-30b330d6-c357-4a01-8813-54603361a76e req-b1d25baf-0258-439a-9a94-09000c55d2c6 service nova] Acquiring lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:37.790439 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-30b330d6-c357-4a01-8813-54603361a76e req-b1d25baf-0258-439a-9a94-09000c55d2c6 service nova] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:37.790580 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-30b330d6-c357-4a01-8813-54603361a76e req-b1d25baf-0258-439a-9a94-09000c55d2c6 service nova] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:37.790704 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-30b330d6-c357-4a01-8813-54603361a76e req-b1d25baf-0258-439a-9a94-09000c55d2c6 service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Processing event network-vif-plugged-31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11756}} Jul 03 04:21:38.413481 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Found WWN 3300000007a01ed40 for multipath device dm-0 {{(pid=98951) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jul 03 04:21:38.414029 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.041s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:38.414457 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] <== connect_volume: return (4041ms) {'type': 'block', 'scsi_wwn': '3300000007a01ed40', 'path': '/dev/dm-0', 'multipath_id': '3300000007a01ed40'} {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:38.414457 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a01ed40', 'path': '/dev/dm-0', 'multipath_id': '3300000007a01ed40'} {{(pid=98951) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jul 03 04:21:38.415956 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.112s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 04:21:38.416609 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebd35f7a-ffca-4456-82ab-90006387117b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 04:21:38.417094 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', 0)] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:38.460548 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf (non-flash) Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b (non-flash) Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36 (non-flash) Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 04:21:38.460940 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cf220c7-4c01-4116-88c8-380fb83927bf', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6ee881b-4344-4a43-8c3c-d21965282d36', '46')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 04:21:38.461391 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', '44')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:38.461976 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b', '43')] {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 04:21:38.462760 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Resulting device map defaultdict(. at 0x76c4502d54e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'): ({'sdf'}, set())}) {{(pid=98951) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 04:21:38.462957 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Removing multipathed devices sdf, sdg {{(pid=98951) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 04:21:38.463179 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Flush multipath device 330000000ce71148c {{(pid=98951) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 04:21:38.499828 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:38.539960 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Started> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:38.540952 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98951) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jul 03 04:21:38.542476 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] VM Started (Lifecycle Event) Jul 03 04:21:38.544313 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Guest created on hypervisor {{(pid=98951) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4885}} Jul 03 04:21:38.545777 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98951) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 04:21:38.548542 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [-] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Instance spawned successfully. Jul 03 04:21:38.551779 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1014}} Jul 03 04:21:38.600035 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 04:21:38.600183 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98951) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 04:21:38.601954 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 04:21:38.615711 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.linuxscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98951) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 04:21:38.615897 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b')] {{(pid=98951) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 04:21:38.629126 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:38.661157 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.40.100,3260] Jul 03 04:21:38.661157 np0000004364 nova-compute[98951]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.40.100,3260] successful. Jul 03 04:21:38.661157 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:38.681006 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:38.692294 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:38.729638 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.50.100,3260] Jul 03 04:21:38.729638 np0000004364 nova-compute[98951]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-ebd35f7a-ffca-4456-82ab-90006387117b, portal: 192.168.50.100,3260] successful. Jul 03 04:21:38.729638 np0000004364 nova-compute[98951]: stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:38.749560 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98951) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 04:21:38.749560 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.base [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 04:21:38.749560 np0000004364 nova-compute[98951]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] <== disconnect_volume: return (2445ms) None {{(pid=98951) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 04:21:38.749560 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] [instance: c7760c72-db16-418b-b3b8-84fab8054f20] Disconnected iSCSI Volume {{(pid=98951) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jul 03 04:21:38.923314 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1923207365',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionsv293testjson-server-57277548',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Yj2Fyp3SZRpYB2rBZZcPbTWonX/mA+GmC/Vc6BAQrNqVpT6Hc4JpMk5blfi1Ue6dV8mzdRfR7qbmKYTn/T3ZLVG/Cu/bFClo+moYfiL66FdO+6nLEszVXzj7+VwYYeA==',key_name='tempest-keypair-209897224',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:38Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b2f692daeca94508859887b79b6f1ab3',ramdisk_id='',reservation_id='r-wvzshjlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ec5f9610-ac5b-441b-b0d5-db3559298a7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-223165141',owner_user_name='tempest-ServerActionsV293TestJSON-223165141-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca140c204734e4fbf4eda5377f08fe7',uuid=683d1775-ad4b-4200-9d1d-ef75e6c95064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:38.923658 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converting VIF {"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:38.924388 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] End _get_guest_xml xml= Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 683d1775-ad4b-4200-9d1d-ef75e6c95064 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: instance-00000014 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: tempest-ServerActionsV293TestJSON-server-1923207365 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 2026-07-03 04:21:33 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: True Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: bare Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: tempest-ServerActionsV293TestJSON-223165141-project-member Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: tempest-ServerActionsV293TestJSON-223165141 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 683d1775-ad4b-4200-9d1d-ef75e6c95064 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 683d1775-ad4b-4200-9d1d-ef75e6c95064 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: hvm Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 128 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: e6ee881b-4344-4a43-8c3c-d21965282d36 Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: /dev/urandom Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: Jul 03 04:21:38.926385 np0000004364 nova-compute[98951]: {{(pid=98951) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8219}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1923207365',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-serveractionsv293testjson-server-57277548',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Yj2Fyp3SZRpYB2rBZZcPbTWonX/mA+GmC/Vc6BAQrNqVpT6Hc4JpMk5blfi1Ue6dV8mzdRfR7qbmKYTn/T3ZLVG/Cu/bFClo+moYfiL66FdO+6nLEszVXzj7+VwYYeA==',key_name='tempest-keypair-209897224',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:38Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000004364',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b2f692daeca94508859887b79b6f1ab3',ramdisk_id='',reservation_id='r-wvzshjlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ec5f9610-ac5b-441b-b0d5-db3559298a7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-223165141',owner_user_name='tempest-ServerActionsV293TestJSON-223165141-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-07-03T04:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca140c204734e4fbf4eda5377f08fe7',uuid=683d1775-ad4b-4200-9d1d-ef75e6c95064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converting VIF {"id": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "address": "fa:16:3e:93:5d:68", "network": {"id": "e36b70c4-d94c-4bca-ae2d-c03b64d4c462", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2058664651-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b2f692daeca94508859887b79b6f1ab3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapccecc6b7-d1", "ovs_interfaceid": "ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG os_vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') {{(pid=98951) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:38.929867 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jul 03 04:21:38.930299 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.930450 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3afc87a5-47f9-52a7-b778-36663b534541', '_type': 'linux-noop'}}, row=False) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:38.931290 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.932108 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:38.934012 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.939574 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.939831 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccecc6b7-d1, may_exist=True, interface_attrs={}) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:38.940188 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccecc6b7-d1, col_values=(('qos', UUID('2d77b7aa-2826-493f-952d-1a9321d6aba8')),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:38.940396 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccecc6b7-d1, col_values=(('external_ids', {'iface-id': 'ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:5d:68', 'vm-uuid': '683d1775-ad4b-4200-9d1d-ef75e6c95064'}),), if_exists=True) {{(pid=98951) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jul 03 04:21:38.943425 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.945442 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jul 03 04:21:38.949314 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:38.950619 np0000004364 nova-compute[98951]: INFO os_vif [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:5d:68,bridge_name='br-int',has_traffic_filtering=True,id=ccecc6b7-d1ed-437c-b905-2fdb8ddc7eb6,network=Network(e36b70c4-d94c-4bca-ae2d-c03b64d4c462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccecc6b7-d1') Jul 03 04:21:39.044488 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:39.047707 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:39.065157 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Found default for hw_cdrom_bus of ide {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:39.065157 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Found default for hw_disk_bus of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:39.065603 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Found default for hw_input_bus of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:39.065978 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Found default for hw_pointer_model of None {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:39.066320 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Found default for hw_video_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:39.066799 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Found default for hw_vif_model of virtio {{(pid=98951) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1043}} Jul 03 04:21:39.330921 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'flavor' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:39.553080 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] During sync_power_state the instance has a pending task (spawning). Skip. Jul 03 04:21:39.553080 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Paused> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:39.553080 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] VM Paused (Lifecycle Event) Jul 03 04:21:39.575047 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Took 7.90 seconds to spawn the instance on the hypervisor. Jul 03 04:21:39.575047 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:39.849968 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8e5bc1aa-24d9-4fd8-94b3-1dc02192c740 req-5be883b3-8412-4f1a-92e9-28f8d5dffc86 service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Received event network-vif-plugged-31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:39.850479 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8e5bc1aa-24d9-4fd8-94b3-1dc02192c740 req-5be883b3-8412-4f1a-92e9-28f8d5dffc86 service nova] Acquiring lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:39.851362 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8e5bc1aa-24d9-4fd8-94b3-1dc02192c740 req-5be883b3-8412-4f1a-92e9-28f8d5dffc86 service nova] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:39.851535 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-8e5bc1aa-24d9-4fd8-94b3-1dc02192c740 req-5be883b3-8412-4f1a-92e9-28f8d5dffc86 service nova] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:39.851699 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-8e5bc1aa-24d9-4fd8-94b3-1dc02192c740 req-5be883b3-8412-4f1a-92e9-28f8d5dffc86 service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] No waiting events found dispatching network-vif-plugged-31a5c6e3-b7ef-4aeb-93a3-7732b923374b {{(pid=98951) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jul 03 04:21:39.851861 np0000004364 nova-compute[98951]: WARNING nova.compute.manager [req-8e5bc1aa-24d9-4fd8-94b3-1dc02192c740 req-5be883b3-8412-4f1a-92e9-28f8d5dffc86 service nova] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Received unexpected event network-vif-plugged-31a5c6e3-b7ef-4aeb-93a3-7732b923374b for instance with vm_state active and task_state None. Jul 03 04:21:40.054951 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:40.058185 np0000004364 nova-compute[98951]: DEBUG nova.virt.driver [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] Emitting event Resumed> {{(pid=98951) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jul 03 04:21:40.058185 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] VM Resumed (Lifecycle Event) Jul 03 04:21:40.086010 np0000004364 nova-compute[98951]: INFO nova.compute.manager [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Took 13.67 seconds to build instance. Jul 03 04:21:40.377618 np0000004364 nova-compute[98951]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98951) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jul 03 04:21:40.483124 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No BDM found with device name hda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:40.483307 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No BDM found with device name vda, not building metadata. {{(pid=98951) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13279}} Jul 03 04:21:40.483507 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] No VIF found with MAC fa:16:3e:93:5d:68, not building metadata {{(pid=98951) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13255}} Jul 03 04:21:40.483965 np0000004364 nova-compute[98951]: INFO nova.virt.libvirt.driver [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] [instance: 683d1775-ad4b-4200-9d1d-ef75e6c95064] Using config drive Jul 03 04:21:40.547117 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Acquiring lock "interface-c7760c72-db16-418b-b3b8-84fab8054f20-852a8c97-f327-4ce6-b02b-74a1bd46c367" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:40.547401 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "interface-c7760c72-db16-418b-b3b8-84fab8054f20-852a8c97-f327-4ce6-b02b-74a1bd46c367" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:40.561944 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Checking state {{(pid=98951) _get_power_state /opt/stack/nova/nova/compute/manager.py:1964}} Jul 03 04:21:40.565046 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [None req-fc1f5730-3e0e-40ba-875b-6e8a5bfaa04b None None] [instance: b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98951) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1544}} Jul 03 04:21:40.587853 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-1a2c8b76-fb30-49bb-8032-885c7ce58286 tempest-AttachVolumeMultiAttachTest-1445524669 tempest-AttachVolumeMultiAttachTest-1445524669-project-member] Lock "b19a6fc7-ad5e-48c5-9980-7791a8cfa7dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.197s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:40.842933 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-bb0217c0-ad79-4369-8832-b1d491a46cd9 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lock "c7760c72-db16-418b-b3b8-84fab8054f20" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.625s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lazy-loading 'ec2_ids' on Instance uuid 683d1775-ad4b-4200-9d1d-ef75e6c95064 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Lazy-loading 'flavor' on Instance uuid c7760c72-db16-418b-b3b8-84fab8054f20 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e5d6a3a8-05d5-41f1-aa83-62ee351a19b5 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Acquiring lock "047087f9-9dc6-43a6-a27b-027548780341" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [None req-e5d6a3a8-05d5-41f1-aa83-62ee351a19b5 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lock "047087f9-9dc6-43a6-a27b-027548780341" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98951) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cbf76e0a-7c7d-41d7-a697-87de83664f8c req-545878a2-28e7-44bd-8b56-08970f756e65 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Received event network-changed-73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:11998}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.compute.manager [req-cbf76e0a-7c7d-41d7-a697-87de83664f8c req-545878a2-28e7-44bd-8b56-08970f756e65 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Refreshing instance network info cache due to event network-changed-73eca3e4-62a9-4cc6-89fb-3e41299e197f. {{(pid=98951) external_instance_event /opt/stack/nova/nova/compute/manager.py:12003}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cbf76e0a-7c7d-41d7-a697-87de83664f8c req-545878a2-28e7-44bd-8b56-08970f756e65 service nova] Acquiring lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG oslo_concurrency.lockutils [req-cbf76e0a-7c7d-41d7-a697-87de83664f8c req-545878a2-28e7-44bd-8b56-08970f756e65 service nova] Acquired lock "refresh_cache-406bb9c3-ccdd-460d-9219-c6981c4a6f82" {{(pid=98951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.network.neutron [req-cbf76e0a-7c7d-41d7-a697-87de83664f8c req-545878a2-28e7-44bd-8b56-08970f756e65 service nova] [instance: 406bb9c3-ccdd-460d-9219-c6981c4a6f82] Refreshing network info cache for port 73eca3e4-62a9-4cc6-89fb-3e41299e197f {{(pid=98951) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.objects.base [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Object Instance<683d1775-ad4b-4200-9d1d-ef75e6c95064> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98951) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-24357c59-614b-4015-b524-6b71a833f387 tempest-ServerActionsV293TestJSON-223165141 tempest-ServerActionsV293TestJSON-223165141-project-member] Lazy-loading 'keypairs' on Instance uuid 683d1775-ad4b-4200-9d1d-ef75e6c95064 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.vif [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-07-03T04:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779117799',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000004364',hostname='tempest-device-tagging-server-779117799',id=22,image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG01GSchcsMSx38ZfTYqg/TH2kuYPxcrMIKUyQQA4dmxeKKXZGEw6So0NOpVy97o7lCf64vPrceOY0K57vXhKJfNsgaQ9RXthAtbaALWl4rLnwB8EHYvJzE9i3Wl/uZwmg==',key_name='tempest-keypair-802072938',keypairs=,launch_index=0,launched_at=2026-07-03T04:20:33Z,launched_on='np0000004364',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000004364',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='470ce7b097604ff79ffa0835affde06b',ramdisk_id='',reservation_id='r-abhge2jh',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60fe5a74-ce6e-4c15-8d86-83089993b0d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428503768',owner_user_name='tempest-TaggedAttachmentsTest-1428503768-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-07-03T04:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4ae2700e8a4e6180b4f7f872b48aa2',uuid=c7760c72-db16-418b-b3b8-84fab8054f20,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98951) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converting VIF {"id": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "address": "fa:16:3e:d8:86:4b", "network": {"id": "8f29548d-b3e4-43bf-8861-146eaf54dd6a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728511649", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "470ce7b097604ff79ffa0835affde06b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap852a8c97-f3", "ovs_interfaceid": "852a8c97-f327-4ce6-b02b-74a1bd46c367", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.network.os_vif_util [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:86:4b,bridge_name='br-int',has_traffic_filtering=True,id=852a8c97-f327-4ce6-b02b-74a1bd46c367,network=Network(8f29548d-b3e4-43bf-8861-146eaf54dd6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852a8c97-f3') {{(pid=98951) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] looking for interface given config: {{(pid=98951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] looking for interface given config: {{(pid=98951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.driver [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] Attempting to detach device tap852a8c97-f3 from instance c7760c72-db16-418b-b3b8-84fab8054f20 from the persistent domain config. {{(pid=98951) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2634}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] detach device xml: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: {{(pid=98951) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.objects.instance [None req-e5d6a3a8-05d5-41f1-aa83-62ee351a19b5 tempest-ServerRescueNegativeTestJSON-764277257 tempest-ServerRescueNegativeTestJSON-764277257-project-member] Lazy-loading 'flavor' on Instance uuid 047087f9-9dc6-43a6-a27b-027548780341 {{(pid=98951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] looking for interface given config: {{(pid=98951) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: DEBUG nova.virt.libvirt.guest [None req-d4964afd-606d-4c08-b161-3c2d3b407a41 tempest-TaggedAttachmentsTest-1428503768 tempest-TaggedAttachmentsTest-1428503768-project-member] interface for config: not found in domain: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: instance-00000016 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: c7760c72-db16-418b-b3b8-84fab8054f20 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: tempest-device-tagging-server-779117799 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: 2026-07-03 04:21:20 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: 192 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: True Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.580674 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: bare Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: qcow2 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 0 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: ide Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: pc Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: virtio Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: tempest-TaggedAttachmentsTest-1428503768-project-member Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: tempest-TaggedAttachmentsTest-1428503768 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 196608 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 1 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: /machine Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: OpenStack Foundation Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: OpenStack Nova Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 33.1.0 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: c7760c72-db16-418b-b3b8-84fab8054f20 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: c7760c72-db16-418b-b3b8-84fab8054f20 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Virtual Machine Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: hvm Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: 131072 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Nehalem Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: destroy Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: restart Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: destroy Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: /usr/bin/qemu-system-x86_64 Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]:
Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]:
Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]:
Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]:
Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]:
Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: Jul 03 04:21:41.583530 np0000004364 nova-compute[98951]: